Jul 03 00:56:29 devstack cinder-volume[75699]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 03 00:56:29 devstack cinder-volume[75699]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 00:56:29 devstack cinder-volume[75699]: we strongly recommend against using it for new projects. Jul 03 00:56:29 devstack cinder-volume[75699]: If you are already using Eventlet, we recommend migrating to a different Jul 03 00:56:29 devstack cinder-volume[75699]: framework. For more detail see Jul 03 00:56:29 devstack cinder-volume[75699]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 00:56:29 devstack cinder-volume[75699]: import eventlet # noqa Jul 03 00:56:32 devstack cinder-volume[75699]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 00:56:32 devstack cinder-volume[75699]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 00:56:32 devstack cinder-volume[75699]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 00:56:33 devstack cinder-volume[75699]: INFO dbcounter [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Registered counter for database cinder Jul 03 00:56:33 devstack cinder-volume[75699]: DEBUG oslo_db.sqlalchemy.engines [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 00:56:33 devstack cinder-volume[75699]: DEBUG dbcounter [-] [75699] Writer thread running {{(pid=75699) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 00:56:33 devstack cinder-volume[75699]: INFO cinder.rpc [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 03 00:56:33 devstack cinder-volume[75699]: INFO cinder.rpc [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 03 00:56:33 devstack cinder-volume[75699]: DEBUG oslo_db.sqlalchemy.engines [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 00:56:33 devstack cinder-volume[75699]: INFO cinder.volume.manager [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Determined volume DB was empty at startup. Jul 03 00:56:33 devstack cinder-volume[75699]: DEBUG cinder.volume.manager [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75699) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 03 00:56:33 devstack cinder-volume[75699]: INFO cinder.volume.manager [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 03 00:56:33 devstack cinder-volume[75699]: WARNING stevedore.named [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 00:56:33 devstack cinder-volume[75699]: WARNING castellan.key_manager [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 00:56:33 devstack cinder-volume[75699]: WARNING cinder.keymgr.conf_key_mgr [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 00:56:33 devstack cinder-volume[75699]: DEBUG cinder.volume.drivers.lvm [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75699) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 03 00:56:33 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] CMD "cinder-rtstool verify" returned: 0 in 0.440s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_db.sqlalchemy.engines [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 00:56:34 devstack cinder-volume[75699]: INFO cinder.rpc [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 03 00:56:34 devstack cinder-volume[75699]: INFO cinder.rpc [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 03 00:56:34 devstack cinder-volume[75699]: WARNING stevedore.named [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 00:56:34 devstack cinder-volume[75699]: WARNING castellan.key_manager [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 00:56:34 devstack cinder-volume[75699]: INFO cinder.volume.manager [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_db.sqlalchemy.engines [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 00:56:34 devstack cinder-volume[75699]: INFO oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Starting 1 workers Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Started child 75866 {{(pid=75699) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Full set of CONF: {{(pid=75699) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] ******************************************************************************** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Configuration options gathered from: {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 00:56:34 devstack cinder-volume[75866]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] ================================================================================ {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] allow_availability_zone_fallback = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] allow_compression_on_image_upload = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] allowed_direct_url_schemes = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] api_rate_limit = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] auth_strategy = keystone {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] az_cache_duration = 3600 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_availability_zone = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_host = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_name = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_stats_polling_interval = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backup_api_class = cinder.backup.api.API {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backup_name_template = backup-%s {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backup_use_same_host = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backup_use_temp_snapshot = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] chap_password = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] chap_username = {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cinder_internal_tenant_project_id = 277dea24fe4641a9b49dd2b939d05263 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cinder_internal_tenant_user_id = ca23ce4b8ba642cd8ad2696fab3dfff9 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cloned_volume_same_az = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cluster = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] compression_format = gzip {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] compute_api_class = cinder.compute.nova.API {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] config_dir = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] config_source = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] control_exchange = openstack {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] debug = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] default_availability_zone = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] default_group_type = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] default_volume_type = lvmdriver-1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] disk_geometry = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] driver_client_cert = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] driver_client_cert_key = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75866]: INFO cinder.volume.manager [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 03 00:56:34 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] driver_data_namespace = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] driver_ssl_cert_path = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] driver_ssl_cert_verify = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] driver_use_ssl = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] enable_force_upload = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] enable_new_services = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] enable_unsupported_driver = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] enforce_multipath_for_image_xfer = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] filter_function = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] glance_api_insecure = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] glance_api_servers = ['http://192.168.122.146/image'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] glance_api_ssl_compression = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] glance_ca_certificates_file = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] glance_catalog_info = image:glance:publicURL {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] glance_certfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] glance_keyfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] glance_num_retries = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] glance_request_timeout = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] goodness_function = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] graceful_shutdown_timeout = 5 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] group_api_class = cinder.group.api.API {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] host = devstack {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] image_compress_on_upload = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] image_conversion_address_space_limit = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] image_conversion_cpu_limit = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] image_conversion_disable = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] image_upload_use_cinder_backend = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] image_upload_use_internal_tenant = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] image_volume_cache_enabled = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] image_volume_cache_max_count = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] image_volume_cache_max_size_gb = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] init_host_max_objects_retrieval = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] instance_format = [instance: %(uuid)s] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] iscsi_target_flags = {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] iscsi_write_cache = on {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] iser_helper = tgtadm {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] iser_ip_address = 192.168.122.146 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] iser_port = 3260 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] log_color = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] log_config_append = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] log_dir = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] log_file = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] log_options = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] log_rotate_interval = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] log_rotate_interval_type = days {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] log_rotation_type = none {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] max_age = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] max_logfile_count = 30 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] max_logfile_size_mb = 200 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] max_over_subscription_ratio = 20.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] message_reap_interval = 86400 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] message_ttl = 2592000 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] migration_create_volume_timeout_secs = 300 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] monkey_patch = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] monkey_patch_modules = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] my_ip = 192.168.122.146 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] no_snapshot_gb_quota = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] num_iser_scan_tries = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] num_shell_tries = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] num_volume_device_scan_tries = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] nvmeof_conn_info_version = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] nvmet_ns_id = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] nvmet_port_id = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] osapi_max_limit = 1000 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] osapi_volume_ext_list = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] osapi_volume_listen_port = 8776 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] osapi_volume_use_ssl = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] osapi_volume_workers = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] per_volume_size_limit = -1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] periodic_fuzzy_delay = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] periodic_interval = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] public_endpoint = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] publish_errors = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] quota_backup_gigabytes = 1000 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] quota_backups = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] quota_gigabytes = 1000 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] quota_groups = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] quota_snapshots = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] quota_volumes = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] rate_limit_burst = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] rate_limit_except_level = CRITICAL {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] rate_limit_interval = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] reinit_driver_count = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] replication_device = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] report_discard_supported = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] report_interval = 120 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] reservation_clean_interval = 86400 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] reservation_expire = 86400 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] reserved_image_namespaces = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] reserved_percentage = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] rpc_response_timeout = 120 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] run_external_periodic_tasks = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] scst_target_driver = iscsi {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] scst_target_iqn_name = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] service_down_time = 720 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] shell_completion = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] snapshot_name_template = snapshot-%s {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] snapshot_same_host = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] split_loggers = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] state_path = /opt/stack/data/cinder {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] storage_availability_zone = nova {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] storage_protocol = iSCSI {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] syslog_log_facility = LOG_USER {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] target_helper = lioadm {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] target_ip_address = 192.168.122.146 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] target_port = 3260 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] target_protocol = iscsi {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] target_secondary_ip_addresses = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] trace_flags = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] transport_url = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] until_refresh = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] use_chap_auth = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] use_default_quota_class = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] use_journal = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] use_json = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] use_multipath_for_image_xfer = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] use_stderr = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] use_syslog = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] verify_glance_signatures = enabled {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] volume_api_class = cinder.volume.api.API {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] volume_backend_name = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] volume_clear = zero {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack sudo[75870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] volume_clear_ionice = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] volume_clear_size = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] volume_copy_bps_limit = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] volume_dd_blocksize = 1M {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack sudo[75870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] volume_name_template = volume-%s {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] volume_service_inithost_offload = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] volume_usage_audit_period = month {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] zoning_mode = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_concurrency.disable_process_locking = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.auth_section = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.auth_type = password {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.auth_version = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.cache = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.certfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.include_service_catalog = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.insecure = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.interface = public {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.keyfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.memcache_password = {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.memcache_username = {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.region_name = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.service_type = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.146/identity {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.backend = dogpile.cache.null {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.backend_argument = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.backend_expiration_time = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.config_prefix = cache.oslo {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.debug_cache_backend = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.enable_retry_client = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.enable_socket_keepalive = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.enabled = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.expiration_time = 600 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.hashclient_retry_attempts = 2 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.memcache_dead_retry = 300 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.memcache_pool_maxsize = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.memcache_sasl_enabled = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.password = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.proxies = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.redis_db = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.redis_server = localhost:6379 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.retry_attempts = 2 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.retry_delay = 0.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.socket_keepalive_count = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.socket_keepalive_idle = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.socket_keepalive_interval = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.socket_timeout = 1.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.tls_allowed_ciphers = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.tls_cafile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.tls_certfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.tls_enabled = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.tls_keyfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cache.username = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] coordination.backend_url = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] database.asyncio_connection = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] database.asyncio_slave_connection = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] database.backend = sqlalchemy {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] database.connection = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] database.connection_debug = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] database.connection_parameters = {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] database.connection_recycle_time = 3600 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] database.connection_trace = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] database.db_inc_retry_interval = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] database.db_max_retries = 20 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] database.db_max_retry_interval = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] database.db_retry_interval = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] database.max_overflow = 50 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] database.max_pool_size = 5 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] database.max_retries = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] database.mysql_wsrep_sync_wait = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] database.pool_timeout = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] database.retry_interval = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] database.slave_connection = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] database.sqlite_synchronous = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] database.synchronous_reader = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] database.use_db_reconnect = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] profiler.connection_string = messaging:// {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] profiler.enabled = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] profiler.es_doc_type = notification {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] profiler.es_scroll_size = 10000 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] profiler.es_scroll_time = 2m {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] profiler.filter_error_trace = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] profiler.hmac_keys = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] profiler.sentinel_service_name = mymaster {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] profiler.socket_timeout = 0.1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] profiler.trace_requests = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] profiler.trace_sqlalchemy = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] profiler_jaeger.process_tags = {} {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] profiler_jaeger.service_name_prefix = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] profiler_otlp.service_name_prefix = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_policy.enforce_new_defaults = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_policy.enforce_scope = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_policy.policy_default_rule = default {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_policy.policy_file = policy.yaml {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] privsep_osbrick.group = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] privsep_osbrick.helper_command = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] privsep_osbrick.user = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cinder_sys_admin.group = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cinder_sys_admin.helper_command = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] cinder_sys_admin.user = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] service_user.auth_section = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] service_user.auth_type = password {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] service_user.cafile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] service_user.certfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] service_user.collect_timing = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] service_user.insecure = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] service_user.keyfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] service_user.send_service_user_token = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] service_user.split_loggers = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] service_user.timeout = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] glance.auth_section = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] glance.auth_type = password {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] glance.certfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] glance.collect_timing = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] glance.insecure = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] glance.keyfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] glance.region_name = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] glance.split_loggers = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] glance.timeout = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.backend_availability_zone = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.chap_password = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.chap_username = {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.disk_geometry = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.driver_client_cert = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.driver_client_cert_key = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.driver_data_namespace = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.driver_use_ssl = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.extra_capabilities = {} {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.filter_function = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.goodness_function = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.iscsi_target_flags = {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.iscsi_write_cache = on {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.iser_helper = tgtadm {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.iser_ip_address = 192.168.122.146 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.iser_port = 3260 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.lvm_share_target = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.lvm_type = auto {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.num_shell_tries = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.replication_device = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.report_discard_supported = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.reserved_percentage = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.target_helper = tgtadm {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.target_ip_address = 192.168.122.146 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.target_port = 3260 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.target_protocol = iscsi {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.trace_flags = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.unique_fqdn_network = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.use_chap_auth = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.volume_backend_name = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.volume_clear = zero {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.volume_clear_ionice = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.volume_clear_size = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_reports.file_event_handler = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_reports.log_dir = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.backend_host = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.chap_password = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.chap_username = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.disk_geometry = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.driver_client_cert = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.extra_capabilities = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.filter_function = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.goodness_function = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.iser_helper = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.iser_ip_address = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.iser_port = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.lvm_share_target = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.lvm_type = auto {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.num_shell_tries = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.replication_device = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.report_discard_supported = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.reserved_percentage = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.scst_target_driver = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.storage_protocol = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.target_helper = lioadm {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.target_ip_address = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.target_port = 3260 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.trace_flags = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.use_chap_auth = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.volume_clear = zero {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.volume_clear_size = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] lvmdriver-1.volumes_dir = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.ssl = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_notifications.driver = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_notifications.retry = -1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] key_manager.fixed_key = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] barbican.barbican_api_version = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] barbican.barbican_endpoint = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] barbican.barbican_endpoint_type = public {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] barbican.barbican_region_name = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] barbican.cafile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] barbican.certfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] barbican.collect_timing = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] barbican.insecure = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] barbican.keyfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] barbican.number_of_retries = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] barbican.retry_delay = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] barbican.send_service_user_token = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] barbican.split_loggers = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] barbican.timeout = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] barbican.verify_ssl = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] barbican.verify_ssl_path = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] barbican_service_user.auth_section = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] barbican_service_user.auth_type = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] barbican_service_user.cafile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] barbican_service_user.certfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] barbican_service_user.collect_timing = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] barbican_service_user.insecure = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] barbican_service_user.keyfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] barbican_service_user.split_loggers = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] barbican_service_user.timeout = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] vault.approle_role_id = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] vault.approle_secret_id = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] vault.kv_mountpoint = secret {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] vault.kv_path = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] vault.kv_version = 2 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] vault.namespace = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] vault.root_token_id = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] vault.ssl_ca_crt_file = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] vault.timeout = 60.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] vault.use_ssl = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 00:56:34 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] ******************************************************************************** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 00:56:35 devstack sudo[75870]: pam_unix(sudo:session): session closed for user root Jul 03 00:56:35 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.690s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:35 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:35 devstack sudo[75937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 00:56:35 devstack sudo[75937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:56:35 devstack sudo[75937]: pam_unix(sudo:session): session closed for user root Jul 03 00:56:35 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.655s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:35 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 00:56:35 devstack cinder-volume[75866]: INFO cinder.brick.local_dev.lvm [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 03 00:56:35 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:35 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:35 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:36 devstack sudo[76176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 00:56:36 devstack sudo[76176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:56:36 devstack sudo[76176]: pam_unix(sudo:session): session closed for user root Jul 03 00:56:36 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:36 devstack cinder-volume[75866]: DEBUG cinder.brick.local_dev.lvm [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75866) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 03 00:56:36 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:36 devstack sudo[76361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 00:56:36 devstack sudo[76361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:56:38 devstack sudo[76361]: pam_unix(sudo:session): session closed for user root Jul 03 00:56:38 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.386s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:38 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:38 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:38 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:38 devstack sudo[76643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 00:56:38 devstack sudo[76643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:56:38 devstack sudo[76643]: pam_unix(sudo:session): session closed for user root Jul 03 00:56:38 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.817s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:38 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:38 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:38 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:38 devstack sudo[76649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 03 00:56:38 devstack sudo[76649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:56:39 devstack sudo[76649]: pam_unix(sudo:session): session closed for user root Jul 03 00:56:39 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.734s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:39 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:39 devstack sudo[76659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 00:56:39 devstack sudo[76659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:56:40 devstack sudo[76659]: pam_unix(sudo:session): session closed for user root Jul 03 00:56:40 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.890s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:40 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:40 devstack sudo[76666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 00:56:40 devstack sudo[76666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:56:41 devstack sudo[76666]: pam_unix(sudo:session): session closed for user root Jul 03 00:56:41 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.833s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:41 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:41 devstack sudo[76671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 00:56:41 devstack sudo[76671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:56:42 devstack sudo[76671]: pam_unix(sudo:session): session closed for user root Jul 03 00:56:42 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.789s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:42 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:42 devstack sudo[76680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 00:56:42 devstack sudo[76680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:56:42 devstack sudo[76680]: pam_unix(sudo:session): session closed for user root Jul 03 00:56:42 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.685s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:42 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:42 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:42 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:42 devstack sudo[76684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 00:56:42 devstack sudo[76684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:56:43 devstack sudo[76684]: pam_unix(sudo:session): session closed for user root Jul 03 00:56:43 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.905s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:43 devstack cinder-volume[75866]: INFO cinder.volume.drivers.lvm [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 03 00:56:43 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:43 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:43 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:43 devstack sudo[76785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 00:56:43 devstack sudo[76785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:56:44 devstack cinder-volume[75699]: DEBUG dbcounter [-] [75699] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75699) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 00:56:44 devstack sudo[76785]: pam_unix(sudo:session): session closed for user root Jul 03 00:56:44 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.691s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:44 devstack cinder-volume[75866]: DEBUG cinder.volume.drivers.lvm [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Updating volume stats {{(pid=75866) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 00:56:44 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:44 devstack sudo[76810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 00:56:44 devstack sudo[76810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:56:45 devstack sudo[76810]: pam_unix(sudo:session): session closed for user root Jul 03 00:56:45 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:45 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:45 devstack sudo[76951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 00:56:45 devstack sudo[76951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:56:45 devstack sudo[76951]: pam_unix(sudo:session): session closed for user root Jul 03 00:56:45 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.683s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:45 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:45 devstack sudo[76955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 00:56:45 devstack sudo[76955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:56:46 devstack sudo[76955]: pam_unix(sudo:session): session closed for user root Jul 03 00:56:46 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.667s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:46 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:46 devstack sudo[76958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 00:56:46 devstack sudo[76958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:56:47 devstack sudo[76958]: pam_unix(sudo:session): session closed for user root Jul 03 00:56:47 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:47 devstack cinder-volume[75866]: INFO cinder.volume.driver [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Driver hasn't implemented _init_vendor_properties() Jul 03 00:56:47 devstack cinder-volume[75866]: DEBUG cinder.volume.driver [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75866) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 03 00:56:47 devstack cinder-volume[75866]: DEBUG oslo_db.sqlalchemy.engines [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75866) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 00:56:47 devstack cinder-volume[75866]: DEBUG dbcounter [-] [75866] Writer thread running {{(pid=75866) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 00:56:47 devstack cinder-volume[75866]: DEBUG cinder.db.api [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Building query based on filter {{(pid=75866) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 03 00:56:47 devstack cinder-volume[75866]: DEBUG cinder.image.image_utils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75866) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 03 00:56:47 devstack cinder-volume[75866]: INFO cinder.keymgr.migration [None req-e3c7c432-4d8f-4490-bc83-72fd14f6b24c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 03 00:56:47 devstack cinder-volume[75866]: DEBUG cinder.volume.drivers.lvm [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Updating volume stats {{(pid=75866) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 00:56:47 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:47 devstack sudo[76966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 00:56:47 devstack sudo[76966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:56:48 devstack sudo[76966]: pam_unix(sudo:session): session closed for user root Jul 03 00:56:48 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:48 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:48 devstack sudo[76969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 00:56:48 devstack sudo[76969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:56:48 devstack sudo[76969]: pam_unix(sudo:session): session closed for user root Jul 03 00:56:48 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.720s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:48 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:48 devstack sudo[76972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 00:56:48 devstack sudo[76972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:56:49 devstack sudo[76972]: pam_unix(sudo:session): session closed for user root Jul 03 00:56:49 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.710s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:49 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:49 devstack sudo[76976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 00:56:49 devstack sudo[76976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:56:50 devstack sudo[76976]: pam_unix(sudo:session): session closed for user root Jul 03 00:56:50 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.684s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:50 devstack cinder-volume[75866]: DEBUG cinder.manager [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Notifying Schedulers of capabilities ... {{(pid=75866) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 00:56:50 devstack cinder-volume[75866]: INFO cinder.volume.manager [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Driver initialization completed successfully. Jul 03 00:56:50 devstack cinder-volume[75866]: INFO cinder.manager [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Initiating service 2 cleanup Jul 03 00:56:50 devstack cinder-volume[75866]: INFO cinder.manager [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Service 2 cleanup completed. Jul 03 00:56:50 devstack cinder-volume[75866]: DEBUG cinder.service [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Creating RPC server for service cinder-volume {{(pid=75866) start /opt/stack/cinder/cinder/service.py:231}} Jul 03 00:56:50 devstack cinder-volume[75866]: DEBUG cinder.service [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75866) start /opt/stack/cinder/cinder/service.py:237}} Jul 03 00:56:50 devstack cinder-volume[75866]: INFO cinder.volume.manager [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 03 00:56:50 devstack cinder-volume[75866]: DEBUG cinder.volume.drivers.lvm [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Updating volume stats {{(pid=75866) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 00:56:50 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:50 devstack sudo[76980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 00:56:50 devstack sudo[76980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:56:50 devstack sudo[76980]: pam_unix(sudo:session): session closed for user root Jul 03 00:56:50 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.684s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:50 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:51 devstack sudo[76987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 00:56:51 devstack sudo[76987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:56:51 devstack sudo[76987]: pam_unix(sudo:session): session closed for user root Jul 03 00:56:51 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:51 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:51 devstack sudo[77044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 00:56:51 devstack sudo[77044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:56:52 devstack sudo[77044]: pam_unix(sudo:session): session closed for user root Jul 03 00:56:52 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.621s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:52 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:56:52 devstack sudo[77047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 00:56:52 devstack sudo[77047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:56:52 devstack sudo[77047]: pam_unix(sudo:session): session closed for user root Jul 03 00:56:52 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:56:52 devstack cinder-volume[75866]: INFO cinder.volume.manager [None req-60c109fe-d5d4-4f94-b39c-a5fdc4e61f06 None None] Driver post RPC initialization completed successfully. Jul 03 00:57:02 devstack cinder-volume[75866]: DEBUG dbcounter [-] [75866] Writing DB stats cinder:SELECT=3 {{(pid=75866) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 00:57:02 devstack cinder-volume[75866]: DEBUG dbcounter [-] [75866] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75866) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 00:57:44 devstack cinder-volume[75866]: DEBUG oslo_service.periodic_task [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75866) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 00:57:44 devstack cinder-volume[75866]: DEBUG cinder.volume.drivers.lvm [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Updating volume stats {{(pid=75866) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 00:57:44 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:57:44 devstack sudo[78702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 00:57:44 devstack sudo[78702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:57:45 devstack sudo[78702]: pam_unix(sudo:session): session closed for user root Jul 03 00:57:45 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.701s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:57:45 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:57:45 devstack sudo[78737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 00:57:45 devstack sudo[78737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:57:46 devstack sudo[78737]: pam_unix(sudo:session): session closed for user root Jul 03 00:57:46 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:57:46 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:57:46 devstack sudo[78740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 00:57:46 devstack sudo[78740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:57:46 devstack sudo[78740]: pam_unix(sudo:session): session closed for user root Jul 03 00:57:46 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.668s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:57:46 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:57:46 devstack sudo[78743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 00:57:46 devstack sudo[78743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:57:47 devstack sudo[78743]: pam_unix(sudo:session): session closed for user root Jul 03 00:57:47 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.669s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:57:47 devstack cinder-volume[75866]: DEBUG cinder.manager [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Notifying Schedulers of capabilities ... {{(pid=75866) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 00:57:47 devstack cinder-volume[75866]: DEBUG oslo_service.periodic_task [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Running periodic task VolumeManager._thread_info {{(pid=75866) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 00:57:47 devstack cinder-volume[75866]: DEBUG cinder.volume.manager [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] thread count: 6 {{(pid=75866) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 00:57:47 devstack cinder-volume[75866]: DEBUG cinder.volume.manager [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] thread info: [<_MainThread(MainThread, started 126363318034560)>, , , , , ] {{(pid=75866) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 00:58:44 devstack cinder-volume[75866]: DEBUG oslo_service.periodic_task [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75866) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 00:58:44 devstack cinder-volume[75866]: DEBUG cinder.volume.drivers.lvm [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Updating volume stats {{(pid=75866) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 00:58:44 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:58:44 devstack sudo[81952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 00:58:44 devstack sudo[81952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:58:45 devstack sudo[81952]: pam_unix(sudo:session): session closed for user root Jul 03 00:58:45 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:58:45 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:58:45 devstack sudo[81971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 00:58:45 devstack sudo[81971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:58:46 devstack sudo[81971]: pam_unix(sudo:session): session closed for user root Jul 03 00:58:46 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:58:46 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:58:46 devstack sudo[81974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 00:58:46 devstack sudo[81974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:58:46 devstack sudo[81974]: pam_unix(sudo:session): session closed for user root Jul 03 00:58:46 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.624s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:58:46 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:58:46 devstack sudo[81977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 00:58:46 devstack sudo[81977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:58:47 devstack sudo[81977]: pam_unix(sudo:session): session closed for user root Jul 03 00:58:47 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:58:47 devstack cinder-volume[75866]: DEBUG cinder.manager [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Notifying Schedulers of capabilities ... {{(pid=75866) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 00:59:02 devstack cinder-volume[75866]: DEBUG dbcounter [-] [75866] Writing DB stats cinder:SELECT=1 {{(pid=75866) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 00:59:02 devstack cinder-volume[75866]: DEBUG dbcounter [-] [75866] Writing DB stats cinder:UPDATE=1 {{(pid=75866) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 00:59:44 devstack cinder-volume[75866]: DEBUG oslo_service.periodic_task [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75866) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 00:59:44 devstack cinder-volume[75866]: DEBUG cinder.volume.drivers.lvm [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Updating volume stats {{(pid=75866) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 00:59:44 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:59:44 devstack sudo[83482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 00:59:44 devstack sudo[83482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:59:45 devstack sudo[83482]: pam_unix(sudo:session): session closed for user root Jul 03 00:59:45 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.666s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:59:45 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:59:45 devstack sudo[83496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 00:59:45 devstack sudo[83496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:59:46 devstack sudo[83496]: pam_unix(sudo:session): session closed for user root Jul 03 00:59:46 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:59:46 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:59:46 devstack sudo[83521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 00:59:46 devstack sudo[83521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:59:46 devstack sudo[83521]: pam_unix(sudo:session): session closed for user root Jul 03 00:59:46 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.653s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:59:46 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 00:59:46 devstack sudo[83535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 00:59:46 devstack sudo[83535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 00:59:47 devstack sudo[83535]: pam_unix(sudo:session): session closed for user root Jul 03 00:59:47 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 00:59:47 devstack cinder-volume[75866]: DEBUG cinder.manager [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Notifying Schedulers of capabilities ... {{(pid=75866) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 00:59:47 devstack cinder-volume[75866]: DEBUG oslo_service.periodic_task [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Running periodic task VolumeManager._thread_info {{(pid=75866) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 00:59:47 devstack cinder-volume[75866]: DEBUG cinder.volume.manager [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] thread count: 6 {{(pid=75866) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 00:59:47 devstack cinder-volume[75866]: DEBUG cinder.volume.manager [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] thread info: [<_MainThread(MainThread, started 126363318034560)>, , , , , ] {{(pid=75866) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:00:44 devstack cinder-volume[75866]: DEBUG oslo_service.periodic_task [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75866) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:00:44 devstack cinder-volume[75866]: DEBUG cinder.volume.drivers.lvm [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Updating volume stats {{(pid=75866) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 03 01:00:44 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:00:44 devstack sudo[84926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 03 01:00:44 devstack sudo[84926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:00:45 devstack sudo[84926]: pam_unix(sudo:session): session closed for user root Jul 03 01:00:45 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:00:45 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:00:45 devstack sudo[84940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 01:00:45 devstack sudo[84940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:00:46 devstack sudo[84940]: pam_unix(sudo:session): session closed for user root Jul 03 01:00:46 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:00:46 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:00:46 devstack sudo[84966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 03 01:00:46 devstack sudo[84966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:00:46 devstack sudo[84966]: pam_unix(sudo:session): session closed for user root Jul 03 01:00:46 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.632s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:00:46 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:00:46 devstack sudo[84972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 03 01:00:46 devstack sudo[84972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:00:47 devstack sudo[84972]: pam_unix(sudo:session): session closed for user root Jul 03 01:00:47 devstack cinder-volume[75866]: DEBUG oslo_concurrency.processutils [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=75866) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:00:47 devstack cinder-volume[75866]: DEBUG cinder.manager [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Notifying Schedulers of capabilities ... {{(pid=75866) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:00:47 devstack cinder-volume[75866]: DEBUG oslo_service.periodic_task [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] Running periodic task VolumeManager._thread_info {{(pid=75866) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:00:47 devstack cinder-volume[75866]: DEBUG cinder.volume.manager [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] thread count: 6 {{(pid=75866) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:00:47 devstack cinder-volume[75866]: DEBUG cinder.volume.manager [None req-8ef36901-65f1-4be9-9162-eb22974e27c3 None None] thread info: [<_MainThread(MainThread, started 126363318034560)>, , , , , ] {{(pid=75866) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:01:02 devstack cinder-volume[75866]: DEBUG dbcounter [-] [75866] Writing DB stats cinder:SELECT=1 {{(pid=75866) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:01:02 devstack cinder-volume[75866]: DEBUG dbcounter [-] [75866] Writing DB stats cinder:UPDATE=1 {{(pid=75866) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:01:31 devstack cinder-volume[75699]: INFO oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Caught SIGTERM, stopping children Jul 03 01:01:31 devstack cinder-volume[75699]: DEBUG oslo_concurrency.lockutils [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Acquiring lock "singleton_lock" {{(pid=75699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 01:01:31 devstack cinder-volume[75699]: DEBUG oslo_concurrency.lockutils [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Acquired lock "singleton_lock" {{(pid=75699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 01:01:31 devstack cinder-volume[75699]: DEBUG oslo_concurrency.lockutils [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Releasing lock "singleton_lock" {{(pid=75699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 01:01:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Stop services. {{(pid=75699) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 03 01:01:31 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Killing children. {{(pid=75699) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 03 01:01:31 devstack cinder-volume[75699]: INFO oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Waiting on 1 children to exit Jul 03 01:01:35 devstack cinder-volume[75866]: DEBUG oslo_concurrency.lockutils [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Acquiring lock "singleton_lock" {{(pid=75866) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 01:01:35 devstack cinder-volume[75866]: DEBUG oslo_concurrency.lockutils [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Acquired lock "singleton_lock" {{(pid=75866) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 01:01:35 devstack cinder-volume[75866]: DEBUG oslo_concurrency.lockutils [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Releasing lock "singleton_lock" {{(pid=75866) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 01:01:35 devstack cinder-volume[75866]: WARNING amqp [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 01:01:35 devstack cinder-volume[75866]: WARNING amqp [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 01:01:35 devstack cinder-volume[75699]: INFO oslo_service.backend._eventlet.service [None req-ed1223a6-1846-4538-9926-4da7657600e5 None None] Child 75866 exited with status 0 Jul 03 01:01:35 devstack cinder-volume[86015]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 03 01:01:35 devstack cinder-volume[86015]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 01:01:35 devstack cinder-volume[86015]: we strongly recommend against using it for new projects. Jul 03 01:01:35 devstack cinder-volume[86015]: If you are already using Eventlet, we recommend migrating to a different Jul 03 01:01:35 devstack cinder-volume[86015]: framework. For more detail see Jul 03 01:01:35 devstack cinder-volume[86015]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 01:01:35 devstack cinder-volume[86015]: import eventlet # noqa Jul 03 01:01:37 devstack cinder-volume[86015]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 01:01:37 devstack cinder-volume[86015]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 01:01:37 devstack cinder-volume[86015]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 01:01:38 devstack cinder-volume[86015]: INFO dbcounter [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] Registered counter for database cinder Jul 03 01:01:38 devstack cinder-volume[86015]: DEBUG oslo_db.sqlalchemy.engines [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86015) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 01:01:38 devstack cinder-volume[86015]: DEBUG dbcounter [-] [86015] Writer thread running {{(pid=86015) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 01:01:38 devstack cinder-volume[86015]: INFO cinder.rpc [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 03 01:01:38 devstack cinder-volume[86015]: INFO cinder.rpc [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 03 01:01:38 devstack cinder-volume[86015]: DEBUG oslo_db.sqlalchemy.engines [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86015) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 01:01:38 devstack cinder-volume[86015]: INFO cinder.volume.manager [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] Determined volume DB was empty at startup. Jul 03 01:01:38 devstack cinder-volume[86015]: DEBUG cinder.volume.manager [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86015) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 03 01:01:38 devstack cinder-volume[86015]: INFO cinder.volume.manager [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 03 01:01:38 devstack cinder-volume[86015]: WARNING stevedore.named [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 01:01:38 devstack cinder-volume[86015]: WARNING castellan.key_manager [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 01:01:38 devstack cinder-volume[86015]: WARNING cinder.keymgr.conf_key_mgr [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 01:01:39 devstack cinder-volume[86015]: INFO cinder.volume.manager [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_db.sqlalchemy.engines [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86015) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 01:01:39 devstack cinder-volume[86015]: INFO oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] Starting 1 workers Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] Started child 86230 {{(pid=86015) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] Full set of CONF: {{(pid=86015) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] ******************************************************************************** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] Configuration options gathered from: {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] ================================================================================ {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] allow_availability_zone_fallback = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] allow_compression_on_image_upload = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] allowed_direct_url_schemes = [] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] api_rate_limit = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] auth_strategy = keystone {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_availability_zone = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_host = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_name = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_stats_polling_interval = 60 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backup_api_class = cinder.backup.api.API {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backup_name_template = backup-%s {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86230]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backup_use_same_host = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backup_use_temp_snapshot = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] chap_password = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] chap_username = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cinder_internal_tenant_project_id = 277dea24fe4641a9b49dd2b939d05263 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cinder_internal_tenant_user_id = ca23ce4b8ba642cd8ad2696fab3dfff9 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cluster = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] compression_format = gzip {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] compute_api_class = cinder.compute.nova.API {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] config_dir = [] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] config_source = [] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] control_exchange = openstack {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] debug = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] default_availability_zone = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] default_group_type = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] default_volume_type = QuobyteHD {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] disk_geometry = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] driver_client_cert = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] driver_client_cert_key = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] driver_data_namespace = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] driver_ssl_cert_path = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] driver_ssl_cert_verify = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] driver_use_ssl = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] enable_new_services = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] enable_unsupported_driver = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] enabled_backends = ['QuobyteHD'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] enforce_multipath_for_image_xfer = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] filter_function = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] glance_api_insecure = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] glance_api_servers = ['http://192.168.122.146/image'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] glance_api_ssl_compression = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] glance_ca_certificates_file = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] glance_catalog_info = image:glance:publicURL {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] glance_certfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] glance_keyfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] glance_num_retries = 3 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] glance_request_timeout = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] goodness_function = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] graceful_shutdown_timeout = 5 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] group_api_class = cinder.group.api.API {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] host = devstack {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] image_compress_on_upload = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] image_conversion_address_space_limit = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] image_conversion_cpu_limit = 60 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] image_conversion_disable = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] image_upload_use_cinder_backend = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] image_upload_use_internal_tenant = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] image_volume_cache_enabled = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] image_volume_cache_max_count = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] image_volume_cache_max_size_gb = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] init_host_max_objects_retrieval = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] instance_format = [instance: %(uuid)s] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] iscsi_target_flags = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] iscsi_write_cache = on {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] iser_helper = tgtadm {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] iser_ip_address = 192.168.122.146 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] iser_port = 3260 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] log_color = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] log_config_append = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] log_dir = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] log_file = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] log_options = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] log_rotate_interval = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] log_rotate_interval_type = days {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] log_rotation_type = none {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] max_age = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] max_logfile_count = 30 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] max_logfile_size_mb = 200 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] max_over_subscription_ratio = 20.0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] message_reap_interval = 86400 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] message_ttl = 2592000 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] migration_create_volume_timeout_secs = 300 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] monkey_patch = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] monkey_patch_modules = [] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] my_ip = 192.168.122.146 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] no_snapshot_gb_quota = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] num_iser_scan_tries = 3 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] num_shell_tries = 3 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] num_volume_device_scan_tries = 3 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] nvmeof_conn_info_version = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] nvmet_ns_id = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] nvmet_port_id = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] osapi_max_limit = 1000 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] osapi_volume_ext_list = [] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] osapi_volume_listen_port = 8776 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] osapi_volume_use_ssl = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] osapi_volume_workers = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] per_volume_size_limit = -1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] periodic_fuzzy_delay = 60 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] periodic_interval = 60 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] public_endpoint = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] publish_errors = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] quota_backup_gigabytes = 1000 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] quota_backups = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] quota_gigabytes = 1000 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] quota_groups = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] quota_snapshots = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] quota_volumes = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] rate_limit_burst = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] rate_limit_except_level = CRITICAL {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] rate_limit_interval = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] reinit_driver_count = 3 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] replication_device = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] report_discard_supported = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] report_interval = 120 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] reservation_clean_interval = 86400 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] reservation_expire = 86400 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] reserved_image_namespaces = [] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] reserved_percentage = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] rpc_response_timeout = 120 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] run_external_periodic_tasks = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] scst_target_driver = iscsi {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] scst_target_iqn_name = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] service_down_time = 720 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] shell_completion = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] snapshot_name_template = snapshot-%s {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] split_loggers = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] state_path = /opt/stack/data/cinder {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] storage_availability_zone = nova {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] storage_protocol = iSCSI {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] syslog_log_facility = LOG_USER {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] target_helper = lioadm {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] target_ip_address = 192.168.122.146 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] target_port = 3260 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] target_protocol = iscsi {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] target_secondary_ip_addresses = [] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] trace_flags = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] transport_url = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] until_refresh = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] use_chap_auth = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] use_default_quota_class = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] use_journal = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] use_json = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] use_multipath_for_image_xfer = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] use_stderr = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] use_syslog = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] verify_glance_signatures = enabled {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] volume_api_class = cinder.volume.api.API {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] volume_backend_name = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] volume_clear = zero {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] volume_clear_ionice = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] volume_clear_size = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] volume_copy_bps_limit = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] volume_dd_blocksize = 1M {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] volume_name_template = volume-%s {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] volume_service_inithost_offload = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] volume_usage_audit_period = month {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] zoning_mode = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_concurrency.disable_process_locking = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.auth_section = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.auth_type = password {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.auth_version = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.cache = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.certfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.include_service_catalog = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.insecure = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.interface = public {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.keyfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.memcache_password = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.memcache_username = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86230]: INFO cinder.volume.manager [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Starting volume driver QuobyteDriver (1.1.14) Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86230]: DEBUG cinder.volume.drivers.remotefs [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86230) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.region_name = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.service_type = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.146/identity {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.backend = dogpile.cache.null {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.backend_argument = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.backend_expiration_time = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.config_prefix = cache.oslo {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.debug_cache_backend = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.enable_retry_client = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.enable_socket_keepalive = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.enabled = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.expiration_time = 600 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.hashclient_retry_attempts = 2 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.memcache_dead_retry = 300 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.memcache_pool_maxsize = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.memcache_sasl_enabled = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.password = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.proxies = [] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.redis_db = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.redis_server = localhost:6379 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.retry_attempts = 2 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.retry_delay = 0.0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.socket_keepalive_count = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.socket_keepalive_idle = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.socket_keepalive_interval = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.socket_timeout = 1.0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.tls_allowed_ciphers = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.tls_cafile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.tls_certfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.tls_enabled = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.tls_keyfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cache.username = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] coordination.backend_url = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] database.asyncio_connection = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] database.asyncio_slave_connection = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] database.backend = sqlalchemy {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] database.connection = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] database.connection_debug = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] database.connection_parameters = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] database.connection_recycle_time = 3600 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] database.connection_trace = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] database.db_inc_retry_interval = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] database.db_max_retries = 20 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] database.db_max_retry_interval = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] database.db_retry_interval = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] database.max_overflow = 50 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] database.max_pool_size = 5 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] database.max_retries = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] database.mysql_wsrep_sync_wait = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] database.pool_timeout = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] database.retry_interval = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] database.slave_connection = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] database.sqlite_synchronous = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] database.synchronous_reader = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] database.use_db_reconnect = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] profiler.connection_string = messaging:// {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] profiler.enabled = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] profiler.es_doc_type = notification {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] profiler.es_scroll_size = 10000 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] profiler.es_scroll_time = 2m {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] profiler.filter_error_trace = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] profiler.hmac_keys = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] profiler.sentinel_service_name = mymaster {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] profiler.socket_timeout = 0.1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] profiler.trace_requests = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] profiler.trace_sqlalchemy = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] profiler_jaeger.process_tags = {} {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] profiler_jaeger.service_name_prefix = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] profiler_otlp.service_name_prefix = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_policy.enforce_new_defaults = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_policy.enforce_scope = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_policy.policy_default_rule = default {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_policy.policy_file = policy.yaml {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] privsep_osbrick.group = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] privsep_osbrick.helper_command = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] privsep_osbrick.user = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cinder_sys_admin.group = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cinder_sys_admin.helper_command = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] cinder_sys_admin.user = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] service_user.auth_section = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] service_user.auth_type = password {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] service_user.cafile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] service_user.certfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] service_user.collect_timing = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] service_user.insecure = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] service_user.keyfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] service_user.send_service_user_token = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] service_user.split_loggers = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] service_user.timeout = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] glance.auth_section = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] glance.auth_type = password {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] glance.certfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] glance.collect_timing = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] glance.insecure = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] glance.keyfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] glance.region_name = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] glance.split_loggers = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] glance.timeout = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.backend_availability_zone = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.chap_password = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.chap_username = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.disk_geometry = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.driver_client_cert = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.driver_client_cert_key = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.driver_data_namespace = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.driver_use_ssl = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.extra_capabilities = {} {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.filter_function = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.goodness_function = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.iscsi_target_flags = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.iscsi_write_cache = on {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.iser_helper = tgtadm {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.iser_ip_address = 192.168.122.146 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.iser_port = 3260 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.nas_host = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.nas_login = admin {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.nas_mount_options = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.nas_password = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.nas_private_key = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.nas_share_path = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.num_shell_tries = 3 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.quobyte_volume_url = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.replication_device = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.report_discard_supported = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.reserved_percentage = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.target_helper = tgtadm {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.target_ip_address = 192.168.122.146 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.target_port = 3260 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.target_protocol = iscsi {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.trace_flags = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.unique_fqdn_network = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.use_chap_auth = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.volume_backend_name = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.volume_clear = zero {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.volume_clear_ionice = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.volume_clear_size = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_reports.file_event_handler = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_reports.log_dir = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.backend_availability_zone = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.backend_host = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.chap_password = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.chap_username = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.chiscsi_conf = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.disk_geometry = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.driver_client_cert = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.driver_data_namespace = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.driver_use_ssl = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.extra_capabilities = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.filter_function = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.goodness_function = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.iser_helper = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.iser_ip_address = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.iser_port = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.iser_target_prefix = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.nas_host = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.nas_login = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.nas_mount_options = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.nas_password = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.nas_private_key = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.nas_share_path = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.nas_ssh_port = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.num_shell_tries = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.nvmet_port_id = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.replication_device = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.report_discard_supported = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.reserved_percentage = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.scst_target_driver = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.storage_protocol = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.target_helper = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.target_ip_address = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.target_port = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.target_prefix = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.target_protocol = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.trace_flags = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86230]: DEBUG cinder.volume.drivers.quobyte [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86230) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 03 01:01:39 devstack cinder-volume[86230]: WARNING cinder.volume.drivers.quobyte [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 03 01:01:39 devstack cinder-volume[86230]: WARNING cinder.volume.drivers.quobyte [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.use_chap_auth = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.volume_clear = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.volume_clear_size = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86230]: DEBUG oslo_concurrency.processutils [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Running cmd (subprocess): mount.quobyte {{(pid=86230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] QuobyteHD.volumes_dir = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.ssl = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_notifications.driver = [] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_notifications.retry = -1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] key_manager.fixed_key = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] barbican.barbican_api_version = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] barbican.barbican_endpoint = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] barbican.barbican_endpoint_type = public {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] barbican.barbican_region_name = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] barbican.cafile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] barbican.certfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] barbican.collect_timing = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] barbican.insecure = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] barbican.keyfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] barbican.number_of_retries = 60 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] barbican.retry_delay = 1 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] barbican.send_service_user_token = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] barbican.split_loggers = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] barbican.timeout = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] barbican.verify_ssl = True {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] barbican.verify_ssl_path = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] barbican_service_user.auth_section = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] barbican_service_user.auth_type = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] barbican_service_user.cafile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] barbican_service_user.certfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] barbican_service_user.collect_timing = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] barbican_service_user.insecure = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] barbican_service_user.keyfile = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] barbican_service_user.split_loggers = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] barbican_service_user.timeout = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] vault.approle_role_id = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] vault.approle_secret_id = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] vault.kv_mountpoint = secret {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] vault.kv_path = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] vault.kv_version = 2 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] vault.namespace = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] vault.root_token_id = **** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] vault.ssl_ca_crt_file = None {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] vault.timeout = 60.0 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] vault.use_ssl = False {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:39 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] ******************************************************************************** {{(pid=86015) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 01:01:39 devstack quobyte-client[86235]: Reading configuration file: /etc/quobyte/client.cfg Jul 03 01:01:39 devstack quobyte-client[86235]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 03 01:01:39 devstack cinder-volume[86230]: DEBUG oslo_concurrency.processutils [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] CMD "mount.quobyte" returned: 1 in 0.088s {{(pid=86230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:01:39 devstack cinder-volume[86230]: DEBUG oslo_concurrency.lockutils [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:01:39 devstack cinder-volume[86230]: DEBUG oslo_concurrency.lockutils [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:01:39 devstack cinder-volume[86230]: DEBUG cinder.volume.drivers.quobyte [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:01:39 devstack cinder-volume[86230]: INFO cinder.volume.drivers.quobyte [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 ... Jul 03 01:01:39 devstack cinder-volume[86230]: DEBUG oslo_concurrency.processutils [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 -c /etc/quobyte/client-cinder.cfg {{(pid=86230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:01:39 devstack sudo[86236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 -c /etc/quobyte/client-cinder.cfg Jul 03 01:01:39 devstack sudo[86236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:01:40 devstack sudo[86236]: pam_unix(sudo:session): session closed for user root Jul 03 01:01:40 devstack cinder-volume[86230]: DEBUG oslo_concurrency.processutils [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.771s {{(pid=86230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:01:40 devstack cinder-volume[86230]: INFO cinder.volume.drivers.quobyte [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 succeeded Jul 03 01:01:40 devstack cinder-volume[86230]: DEBUG cinder.volume.drivers.quobyte [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:01:40 devstack cinder-volume[86230]: DEBUG oslo_concurrency.lockutils [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.784s {{(pid=86230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:01:40 devstack cinder-volume[86230]: DEBUG oslo_concurrency.processutils [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:01:40 devstack sudo[86305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:01:40 devstack sudo[86305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:01:40 devstack sudo[86305]: pam_unix(sudo:session): session closed for user root Jul 03 01:01:40 devstack cinder-volume[86230]: DEBUG oslo_concurrency.processutils [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.643s {{(pid=86230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:01:40 devstack cinder-volume[86230]: INFO cinder.volume.driver [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Driver hasn't implemented _init_vendor_properties() Jul 03 01:01:40 devstack cinder-volume[86230]: DEBUG cinder.volume.driver [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86230) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 03 01:01:40 devstack cinder-volume[86230]: DEBUG oslo_db.sqlalchemy.engines [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86230) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 01:01:41 devstack cinder-volume[86230]: DEBUG dbcounter [-] [86230] Writer thread running {{(pid=86230) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 01:01:41 devstack cinder-volume[86230]: DEBUG cinder.db.api [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Building query based on filter {{(pid=86230) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 03 01:01:41 devstack cinder-volume[86230]: DEBUG cinder.image.image_utils [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86230) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 03 01:01:41 devstack cinder-volume[86230]: INFO cinder.keymgr.migration [None req-738c1b7d-af8c-4406-8a77-217c13eaa1d0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 03 01:01:41 devstack cinder-volume[86230]: DEBUG oslo_concurrency.lockutils [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:01:41 devstack cinder-volume[86230]: DEBUG oslo_concurrency.lockutils [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:01:41 devstack cinder-volume[86230]: DEBUG cinder.volume.drivers.quobyte [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:01:41 devstack cinder-volume[86230]: DEBUG cinder.volume.drivers.quobyte [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:01:41 devstack cinder-volume[86230]: DEBUG oslo_concurrency.lockutils [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:01:41 devstack cinder-volume[86230]: DEBUG oslo_concurrency.processutils [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:01:41 devstack sudo[86309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:01:41 devstack sudo[86309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:01:41 devstack sudo[86309]: pam_unix(sudo:session): session closed for user root Jul 03 01:01:41 devstack cinder-volume[86230]: DEBUG oslo_concurrency.processutils [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.667s {{(pid=86230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:01:41 devstack cinder-volume[86230]: DEBUG cinder.manager [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Notifying Schedulers of capabilities ... {{(pid=86230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:01:41 devstack cinder-volume[86230]: INFO cinder.volume.manager [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Driver initialization completed successfully. Jul 03 01:01:41 devstack cinder-volume[86230]: INFO cinder.manager [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Initiating service 3 cleanup Jul 03 01:01:41 devstack cinder-volume[86230]: INFO cinder.manager [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Service 3 cleanup completed. Jul 03 01:01:41 devstack cinder-volume[86230]: DEBUG cinder.service [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Creating RPC server for service cinder-volume {{(pid=86230) start /opt/stack/cinder/cinder/service.py:231}} Jul 03 01:01:41 devstack cinder-volume[86230]: DEBUG cinder.service [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86230) start /opt/stack/cinder/cinder/service.py:237}} Jul 03 01:01:41 devstack cinder-volume[86230]: INFO cinder.volume.manager [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 03 01:01:41 devstack cinder-volume[86230]: DEBUG oslo_concurrency.lockutils [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:01:41 devstack cinder-volume[86230]: DEBUG oslo_concurrency.lockutils [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:01:41 devstack cinder-volume[86230]: DEBUG cinder.volume.drivers.quobyte [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:01:41 devstack cinder-volume[86230]: DEBUG cinder.volume.drivers.quobyte [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:01:41 devstack cinder-volume[86230]: DEBUG oslo_concurrency.lockutils [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:01:41 devstack cinder-volume[86230]: DEBUG oslo_concurrency.processutils [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:01:41 devstack sudo[86317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:01:41 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:01:42 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root Jul 03 01:01:42 devstack cinder-volume[86230]: DEBUG oslo_concurrency.processutils [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.659s {{(pid=86230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:01:42 devstack cinder-volume[86230]: INFO cinder.volume.manager [None req-5d533e12-ee51-4ea8-a9ec-a0f022239bdc None None] Driver post RPC initialization completed successfully. Jul 03 01:01:46 devstack cinder-volume[86230]: DEBUG oslo_concurrency.lockutils [None req-3bffe548-54ec-47e0-b945-593d334f29ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:01:46 devstack cinder-volume[86230]: DEBUG oslo_concurrency.lockutils [None req-3bffe548-54ec-47e0-b945-593d334f29ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:01:46 devstack cinder-volume[86230]: DEBUG cinder.volume.drivers.quobyte [None req-3bffe548-54ec-47e0-b945-593d334f29ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86230) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:01:46 devstack cinder-volume[86230]: DEBUG cinder.volume.drivers.quobyte [None req-3bffe548-54ec-47e0-b945-593d334f29ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86230) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:01:46 devstack cinder-volume[86230]: DEBUG oslo_concurrency.lockutils [None req-3bffe548-54ec-47e0-b945-593d334f29ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86230) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:01:46 devstack cinder-volume[86230]: DEBUG oslo_concurrency.processutils [None req-3bffe548-54ec-47e0-b945-593d334f29ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:01:46 devstack sudo[86430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:01:46 devstack sudo[86430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:01:47 devstack sudo[86430]: pam_unix(sudo:session): session closed for user root Jul 03 01:01:47 devstack cinder-volume[86230]: DEBUG oslo_concurrency.processutils [None req-3bffe548-54ec-47e0-b945-593d334f29ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.646s {{(pid=86230) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:01:47 devstack cinder-volume[86230]: DEBUG cinder.manager [None req-3bffe548-54ec-47e0-b945-593d334f29ed None None] Notifying Schedulers of capabilities ... {{(pid=86230) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:01:48 devstack cinder-volume[86015]: INFO oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] Caught SIGTERM, stopping children Jul 03 01:01:48 devstack cinder-volume[86015]: DEBUG oslo_concurrency.lockutils [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] Acquiring lock "singleton_lock" {{(pid=86015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 01:01:48 devstack cinder-volume[86015]: DEBUG oslo_concurrency.lockutils [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] Acquired lock "singleton_lock" {{(pid=86015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 01:01:48 devstack cinder-volume[86015]: DEBUG oslo_concurrency.lockutils [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] Releasing lock "singleton_lock" {{(pid=86015) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 01:01:48 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] Stop services. {{(pid=86015) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 03 01:01:48 devstack cinder-volume[86015]: DEBUG oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] Killing children. {{(pid=86015) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 03 01:01:48 devstack cinder-volume[86015]: INFO oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] Waiting on 1 children to exit Jul 03 01:01:50 devstack cinder-volume[86230]: DEBUG oslo_concurrency.lockutils [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] Acquiring lock "singleton_lock" {{(pid=86230) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 01:01:50 devstack cinder-volume[86230]: DEBUG oslo_concurrency.lockutils [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] Acquired lock "singleton_lock" {{(pid=86230) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 01:01:50 devstack cinder-volume[86230]: DEBUG oslo_concurrency.lockutils [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] Releasing lock "singleton_lock" {{(pid=86230) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 01:01:50 devstack cinder-volume[86230]: WARNING amqp [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 01:01:50 devstack cinder-volume[86230]: WARNING amqp [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 03 01:01:50 devstack cinder-volume[86015]: INFO oslo_service.backend._eventlet.service [None req-3f963591-18ed-4a16-abbe-67eaa6330114 None None] Child 86230 exited with status 0 Jul 03 01:01:50 devstack cinder-volume[86507]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 03 01:01:50 devstack cinder-volume[86507]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 01:01:50 devstack cinder-volume[86507]: we strongly recommend against using it for new projects. Jul 03 01:01:50 devstack cinder-volume[86507]: If you are already using Eventlet, we recommend migrating to a different Jul 03 01:01:50 devstack cinder-volume[86507]: framework. For more detail see Jul 03 01:01:50 devstack cinder-volume[86507]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 01:01:50 devstack cinder-volume[86507]: import eventlet # noqa Jul 03 01:01:53 devstack cinder-volume[86507]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86507) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 03 01:01:53 devstack cinder-volume[86507]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86507) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 03 01:01:53 devstack cinder-volume[86507]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86507) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 03 01:01:54 devstack cinder-volume[86507]: INFO dbcounter [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] Registered counter for database cinder Jul 03 01:01:54 devstack cinder-volume[86507]: DEBUG oslo_db.sqlalchemy.engines [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86507) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG dbcounter [-] [86507] Writer thread running {{(pid=86507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 01:01:55 devstack cinder-volume[86507]: INFO cinder.rpc [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 03 01:01:55 devstack cinder-volume[86507]: INFO cinder.rpc [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_db.sqlalchemy.engines [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86507) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 01:01:55 devstack cinder-volume[86507]: INFO cinder.volume.manager [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] Determined volume DB was empty at startup. Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG cinder.volume.manager [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86507) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 03 01:01:55 devstack cinder-volume[86507]: WARNING stevedore.named [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 03 01:01:55 devstack cinder-volume[86507]: WARNING castellan.key_manager [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 01:01:55 devstack cinder-volume[86507]: WARNING cinder.keymgr.conf_key_mgr [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 03 01:01:55 devstack cinder-volume[86507]: INFO cinder.volume.manager [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_db.sqlalchemy.engines [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86507) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 01:01:55 devstack cinder-volume[86507]: INFO oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] Starting 1 workers Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] Started child 86772 {{(pid=86507) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] Full set of CONF: {{(pid=86507) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] ******************************************************************************** {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] Configuration options gathered from: {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] ================================================================================ {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] allow_availability_zone_fallback = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] allow_compression_on_image_upload = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] allowed_direct_url_schemes = [] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] api_rate_limit = True {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] auth_strategy = keystone {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_availability_zone = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_host = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_name = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_stats_polling_interval = 60 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backup_api_class = cinder.backup.api.API {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backup_name_template = backup-%s {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backup_use_same_host = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backup_use_temp_snapshot = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] chap_password = **** {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] chap_username = {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cinder_internal_tenant_project_id = 277dea24fe4641a9b49dd2b939d05263 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86772]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cinder_internal_tenant_user_id = ca23ce4b8ba642cd8ad2696fab3dfff9 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cluster = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] compression_format = gzip {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] compute_api_class = cinder.compute.nova.API {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] config_dir = [] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] config_source = [] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] control_exchange = openstack {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] debug = True {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] default_availability_zone = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] default_group_type = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] default_volume_type = QuobyteHD {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] disk_geometry = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] driver_client_cert = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] driver_client_cert_key = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] driver_data_namespace = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] driver_ssl_cert_path = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] driver_ssl_cert_verify = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] driver_use_ssl = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] enable_new_services = True {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] enable_unsupported_driver = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] enabled_backends = ['QuobyteHD'] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] enforce_multipath_for_image_xfer = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] filter_function = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] glance_api_insecure = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] glance_api_servers = ['http://192.168.122.146/image'] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] glance_api_ssl_compression = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] glance_ca_certificates_file = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] glance_catalog_info = image:glance:publicURL {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] glance_certfile = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] glance_keyfile = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] glance_num_retries = 3 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] glance_request_timeout = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] goodness_function = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] graceful_shutdown_timeout = 5 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] group_api_class = cinder.group.api.API {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] host = devstack {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] image_compress_on_upload = True {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] image_conversion_address_space_limit = 1 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] image_conversion_cpu_limit = 60 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] image_conversion_disable = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] image_upload_use_cinder_backend = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] image_upload_use_internal_tenant = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] image_volume_cache_enabled = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] image_volume_cache_max_count = 0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] image_volume_cache_max_size_gb = 0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] init_host_max_objects_retrieval = 0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] instance_format = [instance: %(uuid)s] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] iscsi_target_flags = {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] iscsi_write_cache = on {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] iser_helper = tgtadm {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] iser_ip_address = 192.168.122.146 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] iser_port = 3260 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] log_color = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] log_config_append = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] log_dir = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] log_file = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] log_options = True {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] log_rotate_interval = 1 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] log_rotate_interval_type = days {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] log_rotation_type = none {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] max_age = 0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] max_logfile_count = 30 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] max_logfile_size_mb = 200 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] max_over_subscription_ratio = 20.0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] message_reap_interval = 86400 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] message_ttl = 2592000 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] migration_create_volume_timeout_secs = 300 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] monkey_patch = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] monkey_patch_modules = [] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] my_ip = 192.168.122.146 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] no_snapshot_gb_quota = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] num_iser_scan_tries = 3 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] num_shell_tries = 3 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] num_volume_device_scan_tries = 3 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] nvmeof_conn_info_version = 1 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] nvmet_ns_id = 10 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] nvmet_port_id = 1 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] osapi_max_limit = 1000 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] osapi_volume_ext_list = [] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] osapi_volume_listen_port = 8776 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] osapi_volume_use_ssl = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] osapi_volume_workers = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] per_volume_size_limit = -1 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] periodic_fuzzy_delay = 60 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] periodic_interval = 60 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] public_endpoint = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] publish_errors = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] quota_backup_gigabytes = 1000 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] quota_backups = 10 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] quota_gigabytes = 1000 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] quota_groups = 10 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] quota_snapshots = 10 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] quota_volumes = 10 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] rate_limit_burst = 0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] rate_limit_except_level = CRITICAL {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] rate_limit_interval = 0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] reinit_driver_count = 3 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] replication_device = **** {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] report_discard_supported = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] report_interval = 120 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] reservation_clean_interval = 86400 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] reservation_expire = 86400 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] reserved_image_namespaces = [] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] reserved_percentage = 0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] rpc_response_timeout = 120 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] run_external_periodic_tasks = True {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] scst_target_driver = iscsi {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] scst_target_iqn_name = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] service_down_time = 720 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] shell_completion = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] snapshot_name_template = snapshot-%s {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] split_loggers = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] state_path = /opt/stack/data/cinder {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] storage_availability_zone = nova {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] storage_protocol = iSCSI {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] syslog_log_facility = LOG_USER {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] target_helper = lioadm {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] target_ip_address = 192.168.122.146 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] target_port = 3260 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] target_protocol = iscsi {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] target_secondary_ip_addresses = [] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] trace_flags = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] transport_url = **** {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] until_refresh = 0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] use_chap_auth = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] use_default_quota_class = True {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] use_journal = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] use_json = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] use_multipath_for_image_xfer = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] use_stderr = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] use_syslog = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] verify_glance_signatures = enabled {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] volume_api_class = cinder.volume.api.API {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] volume_backend_name = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] volume_clear = zero {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] volume_clear_ionice = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] volume_clear_size = 0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] volume_copy_bps_limit = 0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] volume_dd_blocksize = 1M {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] volume_name_template = volume-%s {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] volume_service_inithost_offload = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] volume_usage_audit_period = month {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] zoning_mode = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_concurrency.disable_process_locking = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.auth_section = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.auth_type = password {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.auth_version = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.cache = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.certfile = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.include_service_catalog = True {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.insecure = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.interface = public {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.keyfile = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.memcache_password = {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Starting volume driver QuobyteDriver (1.1.14) Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-767af054-2822-44fb-b327-6e24dd49679c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86772) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.memcache_username = {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.region_name = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.service_type = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.146/identity {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.backend = dogpile.cache.null {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.backend_argument = **** {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.backend_expiration_time = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.config_prefix = cache.oslo {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.debug_cache_backend = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.enable_retry_client = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.enable_socket_keepalive = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.enabled = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.expiration_time = 600 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.hashclient_retry_attempts = 2 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.memcache_dead_retry = 300 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.memcache_pool_maxsize = 10 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.memcache_sasl_enabled = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.password = **** {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.proxies = [] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.redis_db = 0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.redis_server = localhost:6379 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.retry_attempts = 2 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.retry_delay = 0.0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.socket_keepalive_count = 1 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.socket_keepalive_idle = 1 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.socket_keepalive_interval = 1 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.socket_timeout = 1.0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.tls_allowed_ciphers = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.tls_cafile = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.tls_certfile = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.tls_enabled = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.tls_keyfile = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cache.username = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] coordination.backend_url = **** {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] database.asyncio_connection = **** {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] database.asyncio_slave_connection = **** {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] database.backend = sqlalchemy {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] database.connection = **** {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] database.connection_debug = 0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] database.connection_parameters = {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] database.connection_recycle_time = 3600 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] database.connection_trace = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] database.db_inc_retry_interval = True {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] database.db_max_retries = 20 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] database.db_max_retry_interval = 10 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] database.db_retry_interval = 1 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] database.max_overflow = 50 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] database.max_pool_size = 5 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] database.max_retries = 10 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] database.mysql_wsrep_sync_wait = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] database.pool_timeout = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] database.retry_interval = 10 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] database.slave_connection = **** {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] database.sqlite_synchronous = True {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] database.synchronous_reader = True {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] database.use_db_reconnect = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] profiler.connection_string = messaging:// {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] profiler.enabled = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] profiler.es_doc_type = notification {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] profiler.es_scroll_size = 10000 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] profiler.es_scroll_time = 2m {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] profiler.filter_error_trace = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] profiler.hmac_keys = **** {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] profiler.sentinel_service_name = mymaster {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] profiler.socket_timeout = 0.1 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] profiler.trace_requests = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] profiler.trace_sqlalchemy = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] profiler_jaeger.process_tags = {} {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] profiler_jaeger.service_name_prefix = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] profiler_otlp.service_name_prefix = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_policy.enforce_new_defaults = True {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_policy.enforce_scope = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_policy.policy_default_rule = default {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_policy.policy_file = policy.yaml {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] privsep_osbrick.group = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] privsep_osbrick.helper_command = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] privsep_osbrick.user = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cinder_sys_admin.group = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cinder_sys_admin.helper_command = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] cinder_sys_admin.user = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] service_user.auth_section = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] service_user.auth_type = password {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] service_user.cafile = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] service_user.certfile = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] service_user.collect_timing = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] service_user.insecure = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] service_user.keyfile = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] service_user.send_service_user_token = True {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] service_user.split_loggers = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] service_user.timeout = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] glance.auth_section = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] glance.auth_type = password {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] glance.certfile = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] glance.collect_timing = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] glance.insecure = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] glance.keyfile = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] glance.region_name = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] glance.split_loggers = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] glance.timeout = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.backend_availability_zone = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.chap_password = **** {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.chap_username = {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.disk_geometry = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.driver_client_cert = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.driver_client_cert_key = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.driver_data_namespace = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.driver_use_ssl = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.extra_capabilities = {} {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.filter_function = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.goodness_function = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.iscsi_target_flags = {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.iscsi_write_cache = on {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.iser_helper = tgtadm {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.iser_ip_address = 192.168.122.146 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.iser_port = 3260 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.nas_host = {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.nas_login = admin {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.nas_mount_options = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.nas_password = **** {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.nas_private_key = {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.nas_share_path = {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.num_shell_tries = 3 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.quobyte_volume_url = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.replication_device = **** {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.report_discard_supported = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.reserved_percentage = 0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.target_helper = tgtadm {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.target_ip_address = 192.168.122.146 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.target_port = 3260 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.target_protocol = iscsi {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.trace_flags = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.unique_fqdn_network = True {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.use_chap_auth = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.volume_backend_name = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.volume_clear = zero {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.volume_clear_ionice = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.volume_clear_size = 0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_reports.file_event_handler = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_reports.log_dir = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.backend_availability_zone = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.backend_host = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.chap_password = **** {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.chap_username = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.chiscsi_conf = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.disk_geometry = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.driver_client_cert = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.driver_data_namespace = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.driver_use_ssl = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.extra_capabilities = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.filter_function = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.goodness_function = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.iser_helper = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.iser_ip_address = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.iser_port = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.iser_target_prefix = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.nas_host = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.nas_login = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.nas_mount_options = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.nas_password = **** {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.nas_private_key = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.nas_share_path = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.nas_ssh_port = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.num_shell_tries = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-767af054-2822-44fb-b327-6e24dd49679c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86772) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 03 01:01:55 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.quobyte [None req-767af054-2822-44fb-b327-6e24dd49679c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 03 01:01:55 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.quobyte [None req-767af054-2822-44fb-b327-6e24dd49679c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Running cmd (subprocess): mount.quobyte {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.nvmet_port_id = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.replication_device = **** {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.report_discard_supported = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.reserved_percentage = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.scst_target_driver = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.storage_protocol = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.target_helper = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.target_ip_address = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.target_port = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.target_prefix = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.target_protocol = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.trace_flags = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.use_chap_auth = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.volume_clear = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.volume_clear_size = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] QuobyteHD.volumes_dir = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack quobyte-client[86774]: Reading configuration file: /etc/quobyte/client.cfg Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack quobyte-client[86774]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.ssl = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_notifications.driver = [] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_notifications.retry = -1 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] key_manager.fixed_key = **** {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] barbican.barbican_api_version = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] barbican.barbican_endpoint = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] barbican.barbican_endpoint_type = public {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] barbican.barbican_region_name = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] barbican.cafile = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] barbican.certfile = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] barbican.collect_timing = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] barbican.insecure = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] barbican.keyfile = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] barbican.number_of_retries = 60 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] barbican.retry_delay = 1 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] barbican.send_service_user_token = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] barbican.split_loggers = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] barbican.timeout = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] barbican.verify_ssl = True {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] barbican.verify_ssl_path = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] barbican_service_user.auth_section = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] barbican_service_user.auth_type = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] barbican_service_user.cafile = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] barbican_service_user.certfile = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] barbican_service_user.collect_timing = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] barbican_service_user.insecure = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] barbican_service_user.keyfile = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] barbican_service_user.split_loggers = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] barbican_service_user.timeout = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] vault.approle_role_id = **** {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] vault.approle_secret_id = **** {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] vault.kv_mountpoint = secret {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] vault.kv_path = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] vault.kv_version = 2 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] vault.namespace = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] vault.root_token_id = **** {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-767af054-2822-44fb-b327-6e24dd49679c None None] CMD "mount.quobyte" returned: 1 in 0.054s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:01:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:01:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:01:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] vault.ssl_ca_crt_file = None {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] vault.timeout = 60.0 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] vault.use_ssl = False {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 03 01:01:55 devstack cinder-volume[86507]: DEBUG oslo_service.backend._eventlet.service [None req-06c4619f-8637-443a-b4c0-95e529364308 None None] ******************************************************************************** {{(pid=86507) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 03 01:01:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:01:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:01:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:01:55 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:01:55 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:01:56 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Jul 03 01:01:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-767af054-2822-44fb-b327-6e24dd49679c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.730s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:01:56 devstack cinder-volume[86772]: INFO cinder.volume.driver [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Driver hasn't implemented _init_vendor_properties() Jul 03 01:01:56 devstack cinder-volume[86772]: DEBUG cinder.volume.driver [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86772) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 03 01:01:56 devstack cinder-volume[86772]: DEBUG oslo_db.sqlalchemy.engines [None req-767af054-2822-44fb-b327-6e24dd49679c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86772) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 03 01:01:56 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writer thread running {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 03 01:01:56 devstack cinder-volume[86772]: DEBUG cinder.db.api [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Building query based on filter {{(pid=86772) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 03 01:01:56 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86772) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 03 01:01:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:01:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:01:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:01:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:01:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:01:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:01:56 devstack cinder-volume[86772]: INFO cinder.keymgr.migration [None req-91e6d960-7ebc-4365-aa13-2221db6bc5d6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 03 01:01:56 devstack sudo[86796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:01:56 devstack sudo[86796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:01:57 devstack sudo[86796]: pam_unix(sudo:session): session closed for user root Jul 03 01:01:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-767af054-2822-44fb-b327-6e24dd49679c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.616s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:01:57 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:01:57 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Driver initialization completed successfully. Jul 03 01:01:57 devstack cinder-volume[86772]: INFO cinder.manager [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Initiating service 3 cleanup Jul 03 01:01:57 devstack cinder-volume[86772]: INFO cinder.manager [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Service 3 cleanup completed. Jul 03 01:01:57 devstack cinder-volume[86772]: DEBUG cinder.service [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Creating RPC server for service cinder-volume {{(pid=86772) start /opt/stack/cinder/cinder/service.py:231}} Jul 03 01:01:57 devstack cinder-volume[86772]: DEBUG cinder.service [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86772) start /opt/stack/cinder/cinder/service.py:237}} Jul 03 01:01:57 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 03 01:01:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:01:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:01:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:01:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:01:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:01:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:01:57 devstack sudo[86809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:01:57 devstack sudo[86809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:01:57 devstack sudo[86809]: pam_unix(sudo:session): session closed for user root Jul 03 01:01:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-767af054-2822-44fb-b327-6e24dd49679c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.660s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:01:57 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-767af054-2822-44fb-b327-6e24dd49679c None None] Driver post RPC initialization completed successfully. Jul 03 01:02:05 devstack cinder-volume[86507]: DEBUG dbcounter [-] [86507] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:02:07 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=3 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:02:07 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:02:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:02:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 6 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:02:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:02:55 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:02:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Flow 'volume_create_manager' (2b668b9f-a908-4f12-9ecf-5fe885676846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:02:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (980ab661-b0f5-4d57-900e-8df4d60a7cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:02:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (980ab661-b0f5-4d57-900e-8df4d60a7cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-189519666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aadb72a59b164cf58ba0f3f8e552cb55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:02:55Z,use_quota=True,user_id='c9147578534f4391bdaa997a7ee158d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:02:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd99817-aa64-4fed-a3fa-83d70dc047b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:02:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd99817-aa64-4fed-a3fa-83d70dc047b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:02:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce4a3e2c-5b91-4a65-93ec-e2cb4043001f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:02:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce4a3e2c-5b91-4a65-93ec-e2cb4043001f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7', 'volume_name': 'volume-54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:02:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4675497-3b6b-499e-8e47-e0e8ac52e4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:02:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4675497-3b6b-499e-8e47-e0e8ac52e4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:02:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff475a85-05ae-4097-881a-a92f7aa4386b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:02:55 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Volume 54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7', 'volume_size': 1} Jul 03 01:02:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:02:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:02:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-189519666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aadb72a59b164cf58ba0f3f8e552cb55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:02:55Z,use_quota=True,user_id='c9147578534f4391bdaa997a7ee158d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:02:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Creating volume 54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:02:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:02:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:02:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:02:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:02:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:02:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:02:55 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:02:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:02:55 devstack sudo[87234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7 1073741824 Jul 03 01:02:55 devstack sudo[87234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:02:56 devstack sudo[87234]: pam_unix(sudo:session): session closed for user root Jul 03 01:02:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7 1073741824" returned: 0 in 1.167s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:02:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:02:56 devstack sudo[87552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7 Jul 03 01:02:56 devstack sudo[87552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:02:57 devstack sudo[87552]: pam_unix(sudo:session): session closed for user root Jul 03 01:02:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7" returned: 0 in 0.721s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:02:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:02:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.949s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:02:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff475a85-05ae-4097-881a-a92f7aa4386b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:02:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f631bd6f-a509-4699-b0e0-9e9cbd2213e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:02:57 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Volume volume-54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7 (54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7): created successfully Jul 03 01:02:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f631bd6f-a509-4699-b0e0-9e9cbd2213e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:02:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Flow 'volume_create_manager' (2b668b9f-a908-4f12-9ecf-5fe885676846) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:02:57 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c81a7744-360c-4f79-8811-754fa8a5130b tempest-TaggedAttachmentsTest-824126936 None] Created volume successfully. Jul 03 01:03:07 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:03:07 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:03:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:03:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:03:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:03:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:03:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:03:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:03:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:03:12 devstack sudo[87700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:03:12 devstack sudo[87700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:03:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.972s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:03:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:03:13 devstack sudo[87700]: pam_unix(sudo:session): session closed for user root Jul 03 01:03:13 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:03:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 6 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:03:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:03:38 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:03:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Flow 'volume_create_manager' (7cbd3b76-7c4b-42e4-a2d9-aff89150dd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:03:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba30227-0848-4660-b23a-37908142c89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:03:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba30227-0848-4660-b23a-37908142c89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-981431401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6bb2222-24cb-423b-8a0b-e3191a103147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='462d97fdf4ad4d93aba97441367ef9a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:03:39Z,use_quota=True,user_id='5897dee55fc949b8ad1cc62758fa7f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:03:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fda6904-3d95-4ecd-9207-d614dd922b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:03:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fda6904-3d95-4ecd-9207-d614dd922b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:03:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f3ace3-05ed-4a57-8482-963d71f21d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:03:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f3ace3-05ed-4a57-8482-963d71f21d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6bb2222-24cb-423b-8a0b-e3191a103147', 'volume_name': 'volume-e6bb2222-24cb-423b-8a0b-e3191a103147', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:03:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1954b4e7-560a-45f5-a570-678c7da7b4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:03:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1954b4e7-560a-45f5-a570-678c7da7b4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:03:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c44f15-c0ce-416b-bf2a-08aa57c55efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:03:38 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Volume e6bb2222-24cb-423b-8a0b-e3191a103147: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6bb2222-24cb-423b-8a0b-e3191a103147', 'volume_size': 1} Jul 03 01:03:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:03:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:03:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-981431401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6bb2222-24cb-423b-8a0b-e3191a103147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='462d97fdf4ad4d93aba97441367ef9a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:03:39Z,use_quota=True,user_id='5897dee55fc949b8ad1cc62758fa7f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:03:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Creating volume e6bb2222-24cb-423b-8a0b-e3191a103147 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:03:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:03:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:03:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:03:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:03:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:03:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:03:39 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:03:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6bb2222-24cb-423b-8a0b-e3191a103147 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:03:39 devstack sudo[88152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6bb2222-24cb-423b-8a0b-e3191a103147 1073741824 Jul 03 01:03:39 devstack sudo[88152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:03:40 devstack sudo[88152]: pam_unix(sudo:session): session closed for user root Jul 03 01:03:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6bb2222-24cb-423b-8a0b-e3191a103147 1073741824" returned: 0 in 1.845s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:03:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6bb2222-24cb-423b-8a0b-e3191a103147 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:03:41 devstack sudo[88163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6bb2222-24cb-423b-8a0b-e3191a103147 Jul 03 01:03:41 devstack sudo[88163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:03:42 devstack sudo[88163]: pam_unix(sudo:session): session closed for user root Jul 03 01:03:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6bb2222-24cb-423b-8a0b-e3191a103147" returned: 0 in 1.347s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:03:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] <== create_volume: return (3303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:03:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.309s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:03:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c44f15-c0ce-416b-bf2a-08aa57c55efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6bb2222-24cb-423b-8a0b-e3191a103147', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:03:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce1214b2-a089-40f5-89a8-9df93048e6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:03:42 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Volume volume-e6bb2222-24cb-423b-8a0b-e3191a103147 (e6bb2222-24cb-423b-8a0b-e3191a103147): created successfully Jul 03 01:03:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce1214b2-a089-40f5-89a8-9df93048e6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:03:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Flow 'volume_create_manager' (7cbd3b76-7c4b-42e4-a2d9-aff89150dd80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:03:42 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b0c941fb-a135-4dec-87c6-5e36cbb1450c tempest-VolumesAdminNegativeTest-683036562 None] Created volume successfully. Jul 03 01:03:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-128177b6-32de-4531-98e4-eacafae40f0e tempest-VolumesAdminNegativeTest-683036562 None] Acquiring lock "cinder-e6bb2222-24cb-423b-8a0b-e3191a103147-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:03:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-128177b6-32de-4531-98e4-eacafae40f0e tempest-VolumesAdminNegativeTest-683036562 None] Lock "cinder-e6bb2222-24cb-423b-8a0b-e3191a103147-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:03:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-128177b6-32de-4531-98e4-eacafae40f0e tempest-VolumesAdminNegativeTest-683036562 None] Acquiring lock "cinder-quobyte-e6bb2222-24cb-423b-8a0b-e3191a103147" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:03:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-128177b6-32de-4531-98e4-eacafae40f0e tempest-VolumesAdminNegativeTest-683036562 None] Lock "cinder-quobyte-e6bb2222-24cb-423b-8a0b-e3191a103147" acquired by "delete_volume" :: waited 0.047s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:03:45 devstack cinder-volume[86772]: INFO oslo.privsep.daemon [None req-128177b6-32de-4531-98e4-eacafae40f0e tempest-VolumesAdminNegativeTest-683036562 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpwpqiz9lx/privsep.sock'] Jul 03 01:03:45 devstack sudo[88208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpwpqiz9lx/privsep.sock Jul 03 01:03:45 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:03:46 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 03 01:03:46 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 01:03:46 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 03 01:03:46 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 01:03:46 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 03 01:03:46 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 03 01:03:46 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 01:03:46 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 01:03:46 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 03 01:03:48 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 03 01:03:48 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 03 01:03:48 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 03 01:03:48 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 01:03:48 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 03 01:03:48 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 03 01:03:48 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 03 01:03:48 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log: Jul 03 01:03:48 devstack cinder-volume[86772]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 03 01:03:49 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root Jul 03 01:03:49 devstack cinder-volume[86772]: INFO oslo.privsep.daemon [None req-128177b6-32de-4531-98e4-eacafae40f0e tempest-VolumesAdminNegativeTest-683036562 None] Spawned new privsep daemon via rootwrap Jul 03 01:03:49 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [None req-128177b6-32de-4531-98e4-eacafae40f0e tempest-VolumesAdminNegativeTest-683036562 None] Accepted privsep connection to /tmp/tmpwpqiz9lx/privsep.sock {{(pid=86772) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 03 01:03:49 devstack cinder-volume[86772]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 03 01:03:49 devstack cinder-volume[86772]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 03 01:03:49 devstack cinder-volume[86772]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 03 01:03:49 devstack cinder-volume[86772]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88216 Jul 03 01:03:49 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d07c238-70a5-4373-bed3-652b04ce0300]: (2,) {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:03:49 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31a1586-5312-44b0-abb3-287c8107d736]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:03:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-128177b6-32de-4531-98e4-eacafae40f0e tempest-VolumesAdminNegativeTest-683036562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6bb2222-24cb-423b-8a0b-e3191a103147 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:03:50 devstack sudo[88218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6bb2222-24cb-423b-8a0b-e3191a103147 Jul 03 01:03:50 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:03:51 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:03:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Flow 'volume_create_manager' (e84d6895-bab2-430d-aa76-904f3af39786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:03:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ff1c4a-09ed-4418-a271-183ead49c402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:03:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ff1c4a-09ed-4418-a271-183ead49c402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1803017694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af45a79d-a6a1-44cf-9498-aaab580871ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c4188a304164362a72c8d2497f5055f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:03:51Z,use_quota=True,user_id='d40fe4a8e4714912867ad9f99c130f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:03:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45918720-d9c4-4da5-a1bb-b21813af7600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:03:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45918720-d9c4-4da5-a1bb-b21813af7600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:03:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09ba0c5-aa72-4e41-9170-ea799d04bf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:03:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09ba0c5-aa72-4e41-9170-ea799d04bf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af45a79d-a6a1-44cf-9498-aaab580871ed', 'volume_name': 'volume-af45a79d-a6a1-44cf-9498-aaab580871ed', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:03:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce407395-1ba3-4463-8b85-62b6a8ee451c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:03:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce407395-1ba3-4463-8b85-62b6a8ee451c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:03:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87856d5e-427e-4f9a-a0e1-0dcc9b3c621c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:03:51 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Volume af45a79d-a6a1-44cf-9498-aaab580871ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af45a79d-a6a1-44cf-9498-aaab580871ed', 'volume_size': 1} Jul 03 01:03:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:03:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:03:51 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1803017694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af45a79d-a6a1-44cf-9498-aaab580871ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c4188a304164362a72c8d2497f5055f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:03:51Z,use_quota=True,user_id='d40fe4a8e4714912867ad9f99c130f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:03:51 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Creating volume af45a79d-a6a1-44cf-9498-aaab580871ed {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:03:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:03:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:03:51 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:03:51 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:03:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:03:51 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:03:51 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:03:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-af45a79d-a6a1-44cf-9498-aaab580871ed 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:03:51 devstack sudo[88222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-af45a79d-a6a1-44cf-9498-aaab580871ed 1073741824 Jul 03 01:03:51 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:03:52 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root Jul 03 01:03:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-128177b6-32de-4531-98e4-eacafae40f0e tempest-VolumesAdminNegativeTest-683036562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6bb2222-24cb-423b-8a0b-e3191a103147" returned: 0 in 2.235s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:03:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-128177b6-32de-4531-98e4-eacafae40f0e tempest-VolumesAdminNegativeTest-683036562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6bb2222-24cb-423b-8a0b-e3191a103147 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:03:52 devstack sudo[88237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6bb2222-24cb-423b-8a0b-e3191a103147 Jul 03 01:03:52 devstack sudo[88237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:03:53 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root Jul 03 01:03:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-af45a79d-a6a1-44cf-9498-aaab580871ed 1073741824" returned: 0 in 2.070s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:03:53 devstack sudo[88237]: pam_unix(sudo:session): session closed for user root Jul 03 01:03:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-128177b6-32de-4531-98e4-eacafae40f0e tempest-VolumesAdminNegativeTest-683036562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6bb2222-24cb-423b-8a0b-e3191a103147" returned: 0 in 1.585s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:03:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-128177b6-32de-4531-98e4-eacafae40f0e tempest-VolumesAdminNegativeTest-683036562 None] Lock "cinder-quobyte-e6bb2222-24cb-423b-8a0b-e3191a103147" released by "delete_volume" :: held 8.483s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:03:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-af45a79d-a6a1-44cf-9498-aaab580871ed {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:03:53 devstack sudo[88266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-af45a79d-a6a1-44cf-9498-aaab580871ed Jul 03 01:03:53 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:03:53 devstack cinder-volume[86772]: WARNING cinder.quota [None req-128177b6-32de-4531-98e4-eacafae40f0e tempest-VolumesAdminNegativeTest-683036562 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:03:53 devstack cinder-volume[86772]: WARNING cinder.quota [None req-128177b6-32de-4531-98e4-eacafae40f0e tempest-VolumesAdminNegativeTest-683036562 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:03:53 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-128177b6-32de-4531-98e4-eacafae40f0e tempest-VolumesAdminNegativeTest-683036562 None] Created reservations ['3627743d-d75c-45d2-adeb-720477f31ad1', '6229b6a2-7cf6-4c76-8d98-355308e99877', '1e0d0591-74ec-48ad-a0e2-03a44b3af630', '652af2af-8a4c-4d5f-a743-aea1c8b5d283'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:03:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-128177b6-32de-4531-98e4-eacafae40f0e tempest-VolumesAdminNegativeTest-683036562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:03:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-128177b6-32de-4531-98e4-eacafae40f0e tempest-VolumesAdminNegativeTest-683036562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:03:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-128177b6-32de-4531-98e4-eacafae40f0e tempest-VolumesAdminNegativeTest-683036562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:03:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-128177b6-32de-4531-98e4-eacafae40f0e tempest-VolumesAdminNegativeTest-683036562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:03:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-128177b6-32de-4531-98e4-eacafae40f0e tempest-VolumesAdminNegativeTest-683036562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:03:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-128177b6-32de-4531-98e4-eacafae40f0e tempest-VolumesAdminNegativeTest-683036562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:03:54 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:03:54 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:03:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-128177b6-32de-4531-98e4-eacafae40f0e tempest-VolumesAdminNegativeTest-683036562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.369s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:03:55 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-128177b6-32de-4531-98e4-eacafae40f0e tempest-VolumesAdminNegativeTest-683036562 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:03:55 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Jul 03 01:03:55 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-128177b6-32de-4531-98e4-eacafae40f0e tempest-VolumesAdminNegativeTest-683036562 None] Deleted volume successfully. Jul 03 01:03:55 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root Jul 03 01:03:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-af45a79d-a6a1-44cf-9498-aaab580871ed" returned: 0 in 2.006s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:03:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] <== create_volume: return (4241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:03:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.244s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:03:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-128177b6-32de-4531-98e4-eacafae40f0e tempest-VolumesAdminNegativeTest-683036562 None] Lock "cinder-e6bb2222-24cb-423b-8a0b-e3191a103147-delete_volume" released by "delete_volume" :: held 10.754s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:03:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87856d5e-427e-4f9a-a0e1-0dcc9b3c621c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af45a79d-a6a1-44cf-9498-aaab580871ed', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:03:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0382fdb-adf9-473d-9e34-536e639de1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:03:55 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Volume volume-af45a79d-a6a1-44cf-9498-aaab580871ed (af45a79d-a6a1-44cf-9498-aaab580871ed): created successfully Jul 03 01:03:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0382fdb-adf9-473d-9e34-536e639de1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:03:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Flow 'volume_create_manager' (e84d6895-bab2-430d-aa76-904f3af39786) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:03:55 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-779bd1ee-6919-4e6f-a751-d98bd3f5f5b1 tempest-ServerRescueNegativeTestJSON-382912758 None] Created volume successfully. Jul 03 01:04:07 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=12,cinder:UPDATE=13,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:04:07 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=7,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:04:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:04:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:04:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:04:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:04:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:04:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:04:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:04:12 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:04:12 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:04:14 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Jul 03 01:04:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.343s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:04:14 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:04:14 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:04:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 8 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:04:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:04:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1b063fff-ba0c-4280-902d-cb4929edbc54 tempest-ServerRescueNegativeTestJSON-382912758 None] Acquiring lock "cinder-af45a79d-a6a1-44cf-9498-aaab580871ed-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:04:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1b063fff-ba0c-4280-902d-cb4929edbc54 tempest-ServerRescueNegativeTestJSON-382912758 None] Lock "cinder-af45a79d-a6a1-44cf-9498-aaab580871ed-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:04:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1b063fff-ba0c-4280-902d-cb4929edbc54 tempest-ServerRescueNegativeTestJSON-382912758 None] Acquiring lock "cinder-quobyte-af45a79d-a6a1-44cf-9498-aaab580871ed" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:04:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1b063fff-ba0c-4280-902d-cb4929edbc54 tempest-ServerRescueNegativeTestJSON-382912758 None] Lock "cinder-quobyte-af45a79d-a6a1-44cf-9498-aaab580871ed" acquired by "delete_volume" :: waited 0.041s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:04:27 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac867933-e9f4-4089-bcd5-c4d22e9271bf]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:04:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1b063fff-ba0c-4280-902d-cb4929edbc54 tempest-ServerRescueNegativeTestJSON-382912758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-af45a79d-a6a1-44cf-9498-aaab580871ed {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:04:27 devstack sudo[88787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-af45a79d-a6a1-44cf-9498-aaab580871ed Jul 03 01:04:27 devstack sudo[88787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:04:29 devstack sudo[88787]: pam_unix(sudo:session): session closed for user root Jul 03 01:04:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1b063fff-ba0c-4280-902d-cb4929edbc54 tempest-ServerRescueNegativeTestJSON-382912758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-af45a79d-a6a1-44cf-9498-aaab580871ed" returned: 0 in 2.020s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:04:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1b063fff-ba0c-4280-902d-cb4929edbc54 tempest-ServerRescueNegativeTestJSON-382912758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-af45a79d-a6a1-44cf-9498-aaab580871ed {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:04:29 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-af45a79d-a6a1-44cf-9498-aaab580871ed Jul 03 01:04:29 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:04:31 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Jul 03 01:04:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1b063fff-ba0c-4280-902d-cb4929edbc54 tempest-ServerRescueNegativeTestJSON-382912758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-af45a79d-a6a1-44cf-9498-aaab580871ed" returned: 0 in 1.533s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:04:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1b063fff-ba0c-4280-902d-cb4929edbc54 tempest-ServerRescueNegativeTestJSON-382912758 None] Lock "cinder-quobyte-af45a79d-a6a1-44cf-9498-aaab580871ed" released by "delete_volume" :: held 3.661s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:04:31 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-1b063fff-ba0c-4280-902d-cb4929edbc54 tempest-ServerRescueNegativeTestJSON-382912758 None] Created reservations ['9b8df491-a865-45bf-b6e5-57d57d96aa56', '90d56a11-e9fd-4ab9-8b60-781e15828551', 'baf46dd6-2202-481d-88db-8123e242c8fb', 'df9630fb-89ce-4017-a634-208fd13db5de'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:04:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1b063fff-ba0c-4280-902d-cb4929edbc54 tempest-ServerRescueNegativeTestJSON-382912758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:04:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1b063fff-ba0c-4280-902d-cb4929edbc54 tempest-ServerRescueNegativeTestJSON-382912758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:04:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1b063fff-ba0c-4280-902d-cb4929edbc54 tempest-ServerRescueNegativeTestJSON-382912758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:04:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1b063fff-ba0c-4280-902d-cb4929edbc54 tempest-ServerRescueNegativeTestJSON-382912758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:04:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1b063fff-ba0c-4280-902d-cb4929edbc54 tempest-ServerRescueNegativeTestJSON-382912758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:04:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1b063fff-ba0c-4280-902d-cb4929edbc54 tempest-ServerRescueNegativeTestJSON-382912758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:04:31 devstack sudo[88802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:04:31 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:04:32 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root Jul 03 01:04:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1b063fff-ba0c-4280-902d-cb4929edbc54 tempest-ServerRescueNegativeTestJSON-382912758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.120s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:04:32 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-1b063fff-ba0c-4280-902d-cb4929edbc54 tempest-ServerRescueNegativeTestJSON-382912758 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:04:32 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1b063fff-ba0c-4280-902d-cb4929edbc54 tempest-ServerRescueNegativeTestJSON-382912758 None] Deleted volume successfully. Jul 03 01:04:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1b063fff-ba0c-4280-902d-cb4929edbc54 tempest-ServerRescueNegativeTestJSON-382912758 None] Lock "cinder-af45a79d-a6a1-44cf-9498-aaab580871ed-delete_volume" released by "delete_volume" :: held 5.324s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:04:36 devstack cinder-volume[86772]: WARNING py.warnings [req-fe20041a-7062-4906-bc21-4fcb94278173 req-38a8c3af-31fe-4178-93e0-673149a3efb9 tempest-TaggedAttachmentsTest-824126936 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 03 01:04:36 devstack cinder-volume[86772]: .first() Jul 03 01:04:36 devstack cinder-volume[86772]: Jul 03 01:04:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-fe20041a-7062-4906-bc21-4fcb94278173 req-38a8c3af-31fe-4178-93e0-673149a3efb9 tempest-TaggedAttachmentsTest-824126936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:04:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-fe20041a-7062-4906-bc21-4fcb94278173 req-38a8c3af-31fe-4178-93e0-673149a3efb9 tempest-TaggedAttachmentsTest-824126936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:04:36 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b5cce0-fd35-420c-9a82-d590243064ab]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:04:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-fe20041a-7062-4906-bc21-4fcb94278173 req-38a8c3af-31fe-4178-93e0-673149a3efb9 tempest-TaggedAttachmentsTest-824126936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:04:36 devstack sudo[88883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7 Jul 03 01:04:36 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:04:37 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root Jul 03 01:04:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-fe20041a-7062-4906-bc21-4fcb94278173 req-38a8c3af-31fe-4178-93e0-673149a3efb9 tempest-TaggedAttachmentsTest-824126936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7" returned: 0 in 0.889s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:04:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-fe20041a-7062-4906-bc21-4fcb94278173 req-38a8c3af-31fe-4178-93e0-673149a3efb9 tempest-TaggedAttachmentsTest-824126936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.915s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:04:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-fe20041a-7062-4906-bc21-4fcb94278173 req-38a8c3af-31fe-4178-93e0-673149a3efb9 tempest-TaggedAttachmentsTest-824126936 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171', 'name': 'volume-54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6ee25fa-59f3-48e8-b2bb-e8cf3bc66749', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:04:37 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-fe20041a-7062-4906-bc21-4fcb94278173 req-38a8c3af-31fe-4178-93e0-673149a3efb9 tempest-TaggedAttachmentsTest-824126936 None] attachment_update completed successfully. Jul 03 01:04:45 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-d20ba45f-e13f-4f68-bbd3-f52aad51479f req-796f12c6-0231-4b62-aef1-c9c58636adcc tempest-TaggedAttachmentsTest-824126936 None] Terminate volume connection completed successfully. Jul 03 01:04:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-d20ba45f-e13f-4f68-bbd3-f52aad51479f req-796f12c6-0231-4b62-aef1-c9c58636adcc tempest-TaggedAttachmentsTest-824126936 None] Deleting attachment a6ee25fa-59f3-48e8-b2bb-e8cf3bc66749. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:04:50 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:04:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Flow 'volume_create_manager' (07ff40eb-5dc3-403b-ae67-76e47612972e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:04:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f492ce8-d279-4b9b-87f1-0bb0dc57c7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:04:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f492ce8-d279-4b9b-87f1-0bb0dc57c7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-392784109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f00f2b1-6cfd-4256-9b64-01eb76959ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b16aa7fd4f14cb3b37baa36dc1eb6aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:04:50Z,use_quota=True,user_id='41ca0a7758e64491a793be7b7de4dcee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:04:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f56d308-a998-4330-b2bd-7a3e342a2ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:04:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f56d308-a998-4330-b2bd-7a3e342a2ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:04:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10bd7986-f9f2-4fc5-9464-775e333fd8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:04:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10bd7986-f9f2-4fc5-9464-775e333fd8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f00f2b1-6cfd-4256-9b64-01eb76959ff9', 'volume_name': 'volume-1f00f2b1-6cfd-4256-9b64-01eb76959ff9', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:04:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e88d1f-170d-4110-a5e8-9bbd7b9c47f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:04:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e88d1f-170d-4110-a5e8-9bbd7b9c47f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:04:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef819af-9eb5-4ffa-947a-df6a0e61127d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:04:50 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Volume 1f00f2b1-6cfd-4256-9b64-01eb76959ff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f00f2b1-6cfd-4256-9b64-01eb76959ff9', 'volume_size': 1} Jul 03 01:04:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:04:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:04:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-392784109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f00f2b1-6cfd-4256-9b64-01eb76959ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b16aa7fd4f14cb3b37baa36dc1eb6aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:04:50Z,use_quota=True,user_id='41ca0a7758e64491a793be7b7de4dcee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:04:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Creating volume 1f00f2b1-6cfd-4256-9b64-01eb76959ff9 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:04:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:04:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:04:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:04:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:04:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:04:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:04:50 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:04:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1f00f2b1-6cfd-4256-9b64-01eb76959ff9 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:04:50 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1f00f2b1-6cfd-4256-9b64-01eb76959ff9 1073741824 Jul 03 01:04:50 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:04:52 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Jul 03 01:04:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1f00f2b1-6cfd-4256-9b64-01eb76959ff9 1073741824" returned: 0 in 1.343s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:04:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1f00f2b1-6cfd-4256-9b64-01eb76959ff9 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:04:52 devstack sudo[89388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1f00f2b1-6cfd-4256-9b64-01eb76959ff9 Jul 03 01:04:52 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:04:53 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root Jul 03 01:04:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1f00f2b1-6cfd-4256-9b64-01eb76959ff9" returned: 0 in 1.169s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:04:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] <== create_volume: return (2601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:04:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.603s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:04:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef819af-9eb5-4ffa-947a-df6a0e61127d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f00f2b1-6cfd-4256-9b64-01eb76959ff9', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:04:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54796b84-5571-4895-9c32-d6887cfa0c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:04:53 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Volume volume-1f00f2b1-6cfd-4256-9b64-01eb76959ff9 (1f00f2b1-6cfd-4256-9b64-01eb76959ff9): created successfully Jul 03 01:04:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54796b84-5571-4895-9c32-d6887cfa0c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:04:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Flow 'volume_create_manager' (07ff40eb-5dc3-403b-ae67-76e47612972e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:04:53 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8428fd7f-2241-4e5d-a2a5-754ed05f74bc tempest-ServerActionsTestOtherA-324537631 None] Created volume successfully. Jul 03 01:05:03 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=17,cinder:SELECT=11,cinder:INSERT=3 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:05:03 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=16,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=2 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:05:11 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:05:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Flow 'volume_create_manager' (6fad8a01-4d2e-442e-883a-67d213b2c72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:05:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d00a22-cb34-4f95-8f24-7e3e23758c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:05:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d00a22-cb34-4f95-8f24-7e3e23758c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-774358173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c4dbb4-6e0f-407e-8190-73545bb17ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86213ee791ca4af3aeb621bfd77f61c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:05:12Z,use_quota=True,user_id='866ec838f95b4341ba58eb118b127adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:05:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27d17d9-b15a-498c-a6be-e8c20baf9d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:05:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27d17d9-b15a-498c-a6be-e8c20baf9d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:05:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502b55f4-96dc-47cb-9086-14e3c25429d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:05:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502b55f4-96dc-47cb-9086-14e3c25429d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53c4dbb4-6e0f-407e-8190-73545bb17ec0', 'volume_name': 'volume-53c4dbb4-6e0f-407e-8190-73545bb17ec0', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:05:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7580de11-9b9b-4221-a610-f5e64bea1644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:05:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7580de11-9b9b-4221-a610-f5e64bea1644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:05:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84258c3d-66d4-4ed1-ac49-62d2190232a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:05:11 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Volume 53c4dbb4-6e0f-407e-8190-73545bb17ec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53c4dbb4-6e0f-407e-8190-73545bb17ec0', 'volume_size': 1} Jul 03 01:05:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:05:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:05:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-774358173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c4dbb4-6e0f-407e-8190-73545bb17ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86213ee791ca4af3aeb621bfd77f61c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:05:12Z,use_quota=True,user_id='866ec838f95b4341ba58eb118b127adc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:05:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Creating volume 53c4dbb4-6e0f-407e-8190-73545bb17ec0 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:05:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:05:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:05:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:05:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:05:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:05:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:05:12 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:05:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-53c4dbb4-6e0f-407e-8190-73545bb17ec0 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:05:12 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-53c4dbb4-6e0f-407e-8190-73545bb17ec0 1073741824 Jul 03 01:05:12 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:05:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-274655f3-2dc3-4028-98b5-071ac1a14601 tempest-TaggedAttachmentsTest-824126936 None] Acquiring lock "cinder-54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:05:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-274655f3-2dc3-4028-98b5-071ac1a14601 tempest-TaggedAttachmentsTest-824126936 None] Lock "cinder-54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:05:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:05:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:05:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:05:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:05:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:05:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:05:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:05:12 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:05:12 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:05:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-274655f3-2dc3-4028-98b5-071ac1a14601 tempest-TaggedAttachmentsTest-824126936 None] Acquiring lock "cinder-quobyte-54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:05:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-274655f3-2dc3-4028-98b5-071ac1a14601 tempest-TaggedAttachmentsTest-824126936 None] Lock "cinder-quobyte-54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7" acquired by "delete_volume" :: waited 0.035s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:05:13 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0422ea-a022-4bf6-a3fe-65fec7a260a2]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:05:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-274655f3-2dc3-4028-98b5-071ac1a14601 tempest-TaggedAttachmentsTest-824126936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:05:13 devstack sudo[89636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7 Jul 03 01:05:13 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:05:13 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Jul 03 01:05:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-53c4dbb4-6e0f-407e-8190-73545bb17ec0 1073741824" returned: 0 in 1.536s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:05:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-53c4dbb4-6e0f-407e-8190-73545bb17ec0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:05:13 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-53c4dbb4-6e0f-407e-8190-73545bb17ec0 Jul 03 01:05:13 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:05:14 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Jul 03 01:05:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.403s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:05:14 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:05:14 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root Jul 03 01:05:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-274655f3-2dc3-4028-98b5-071ac1a14601 tempest-TaggedAttachmentsTest-824126936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7" returned: 0 in 1.393s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:05:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-274655f3-2dc3-4028-98b5-071ac1a14601 tempest-TaggedAttachmentsTest-824126936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:05:14 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7 Jul 03 01:05:14 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:05:14 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Jul 03 01:05:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-53c4dbb4-6e0f-407e-8190-73545bb17ec0" returned: 0 in 1.191s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:05:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] <== create_volume: return (2848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:05:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.850s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:05:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84258c3d-66d4-4ed1-ac49-62d2190232a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53c4dbb4-6e0f-407e-8190-73545bb17ec0', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:05:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482a4bb1-d3b6-498b-8521-a48c7007ab46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:05:14 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Volume volume-53c4dbb4-6e0f-407e-8190-73545bb17ec0 (53c4dbb4-6e0f-407e-8190-73545bb17ec0): created successfully Jul 03 01:05:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482a4bb1-d3b6-498b-8521-a48c7007ab46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:05:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Flow 'volume_create_manager' (6fad8a01-4d2e-442e-883a-67d213b2c72f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:05:14 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-98950ece-b4f9-4367-87ca-350daa797b9c tempest-DeleteServersTestJSON-1394055294 None] Created volume successfully. Jul 03 01:05:15 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Jul 03 01:05:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-274655f3-2dc3-4028-98b5-071ac1a14601 tempest-TaggedAttachmentsTest-824126936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7" returned: 0 in 0.862s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:05:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-274655f3-2dc3-4028-98b5-071ac1a14601 tempest-TaggedAttachmentsTest-824126936 None] Lock "cinder-quobyte-54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7" released by "delete_volume" :: held 2.355s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:05:15 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-274655f3-2dc3-4028-98b5-071ac1a14601 tempest-TaggedAttachmentsTest-824126936 None] Created reservations ['894eac9d-d727-4fee-b88b-9424a0706d22', '8419d90d-6a71-4c3c-ae45-231b3754e955', '6c625603-f97c-47ba-9187-669bf8d8fe5e', '0a440eb6-d008-4364-bb90-1099cec94b5d'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:05:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-274655f3-2dc3-4028-98b5-071ac1a14601 tempest-TaggedAttachmentsTest-824126936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:05:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-274655f3-2dc3-4028-98b5-071ac1a14601 tempest-TaggedAttachmentsTest-824126936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:05:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-274655f3-2dc3-4028-98b5-071ac1a14601 tempest-TaggedAttachmentsTest-824126936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:05:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-274655f3-2dc3-4028-98b5-071ac1a14601 tempest-TaggedAttachmentsTest-824126936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:05:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-274655f3-2dc3-4028-98b5-071ac1a14601 tempest-TaggedAttachmentsTest-824126936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:05:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-274655f3-2dc3-4028-98b5-071ac1a14601 tempest-TaggedAttachmentsTest-824126936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:05:15 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:05:15 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:05:16 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Jul 03 01:05:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-274655f3-2dc3-4028-98b5-071ac1a14601 tempest-TaggedAttachmentsTest-824126936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.767s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:05:16 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-274655f3-2dc3-4028-98b5-071ac1a14601 tempest-TaggedAttachmentsTest-824126936 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:05:16 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-274655f3-2dc3-4028-98b5-071ac1a14601 tempest-TaggedAttachmentsTest-824126936 None] Deleted volume successfully. Jul 03 01:05:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-274655f3-2dc3-4028-98b5-071ac1a14601 tempest-TaggedAttachmentsTest-824126936 None] Lock "cinder-54fafcf0-9199-4eb8-b9a5-e7f78fb67bf7-delete_volume" released by "delete_volume" :: held 3.554s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:05:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-6ae93754-0d25-4cc8-acc8-da6edc318e60 req-2e97e64e-ba11-4048-a0bb-df6d1f2b0aee tempest-DeleteServersTestJSON-1394055294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:05:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-6ae93754-0d25-4cc8-acc8-da6edc318e60 req-2e97e64e-ba11-4048-a0bb-df6d1f2b0aee tempest-DeleteServersTestJSON-1394055294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:05:19 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18e7acf-1f7b-4451-bb64-fe13dcd0682b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:05:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-6ae93754-0d25-4cc8-acc8-da6edc318e60 req-2e97e64e-ba11-4048-a0bb-df6d1f2b0aee tempest-DeleteServersTestJSON-1394055294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-53c4dbb4-6e0f-407e-8190-73545bb17ec0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:05:19 devstack sudo[89747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-53c4dbb4-6e0f-407e-8190-73545bb17ec0 Jul 03 01:05:19 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:05:20 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root Jul 03 01:05:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-6ae93754-0d25-4cc8-acc8-da6edc318e60 req-2e97e64e-ba11-4048-a0bb-df6d1f2b0aee tempest-DeleteServersTestJSON-1394055294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-53c4dbb4-6e0f-407e-8190-73545bb17ec0" returned: 0 in 1.445s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:05:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-6ae93754-0d25-4cc8-acc8-da6edc318e60 req-2e97e64e-ba11-4048-a0bb-df6d1f2b0aee tempest-DeleteServersTestJSON-1394055294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.486s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:05:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-6ae93754-0d25-4cc8-acc8-da6edc318e60 req-2e97e64e-ba11-4048-a0bb-df6d1f2b0aee tempest-DeleteServersTestJSON-1394055294 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171', 'name': 'volume-53c4dbb4-6e0f-407e-8190-73545bb17ec0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '913ebfd4-cd1c-4bae-9604-0186a5b67b5b', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:05:20 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-6ae93754-0d25-4cc8-acc8-da6edc318e60 req-2e97e64e-ba11-4048-a0bb-df6d1f2b0aee tempest-DeleteServersTestJSON-1394055294 None] attachment_update completed successfully. Jul 03 01:05:30 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=16,cinder:UPDATE=10,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:05:30 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=9,cinder:UPDATE=15,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:05:32 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-a3c0eb86-c524-428f-971a-6cd84db97435 req-5007b6ff-57a3-4cf0-9dc6-a44f5abcb0d9 tempest-DeleteServersTestJSON-1394055294 None] Terminate volume connection completed successfully. Jul 03 01:05:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-a3c0eb86-c524-428f-971a-6cd84db97435 req-5007b6ff-57a3-4cf0-9dc6-a44f5abcb0d9 tempest-DeleteServersTestJSON-1394055294 None] Deleting attachment 913ebfd4-cd1c-4bae-9604-0186a5b67b5b. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:05:35 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:05:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Flow 'volume_create_manager' (241cd944-d499-41d1-a5e2-67ad77ac89cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:05:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7107714f-6a35-41d9-8703-d433ed292c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:05:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7107714f-6a35-41d9-8703-d433ed292c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1030346890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0241ef67-5188-477a-9487-406d4962ce4d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7193cba28f0445a7b390e682bb80aef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:05:35Z,use_quota=True,user_id='f42e1e45018946dcb3ceb40ce0981250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:05:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c5cd2a-9dd4-4402-8334-087d6cd32a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:05:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c5cd2a-9dd4-4402-8334-087d6cd32a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:05:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7261d850-b090-4fc6-b7a5-67183cd383d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:05:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7261d850-b090-4fc6-b7a5-67183cd383d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0241ef67-5188-477a-9487-406d4962ce4d', 'volume_name': 'volume-0241ef67-5188-477a-9487-406d4962ce4d', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:05:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e92cd2-aca0-4dc1-9543-2bea2ad884ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:05:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e92cd2-aca0-4dc1-9543-2bea2ad884ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:05:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (497d9a03-23ed-4035-a9cb-65d9cf6a4179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:05:35 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Volume 0241ef67-5188-477a-9487-406d4962ce4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0241ef67-5188-477a-9487-406d4962ce4d', 'volume_size': 1} Jul 03 01:05:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:05:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:05:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1030346890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0241ef67-5188-477a-9487-406d4962ce4d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7193cba28f0445a7b390e682bb80aef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:05:35Z,use_quota=True,user_id='f42e1e45018946dcb3ceb40ce0981250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:05:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Creating volume 0241ef67-5188-477a-9487-406d4962ce4d {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:05:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:05:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:05:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:05:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:05:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:05:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:05:35 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:05:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0241ef67-5188-477a-9487-406d4962ce4d 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:05:35 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0241ef67-5188-477a-9487-406d4962ce4d 1073741824 Jul 03 01:05:35 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:05:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9890caa1-be66-4067-abdf-3739a6ff08f5 tempest-DeleteServersTestJSON-1394055294 None] Acquiring lock "cinder-53c4dbb4-6e0f-407e-8190-73545bb17ec0-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:05:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9890caa1-be66-4067-abdf-3739a6ff08f5 tempest-DeleteServersTestJSON-1394055294 None] Lock "cinder-53c4dbb4-6e0f-407e-8190-73545bb17ec0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:05:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9890caa1-be66-4067-abdf-3739a6ff08f5 tempest-DeleteServersTestJSON-1394055294 None] Acquiring lock "cinder-quobyte-53c4dbb4-6e0f-407e-8190-73545bb17ec0" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:05:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9890caa1-be66-4067-abdf-3739a6ff08f5 tempest-DeleteServersTestJSON-1394055294 None] Lock "cinder-quobyte-53c4dbb4-6e0f-407e-8190-73545bb17ec0" acquired by "delete_volume" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:05:36 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b8ebbb-3aef-47c7-8fd0-e6947ae0371e]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:05:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9890caa1-be66-4067-abdf-3739a6ff08f5 tempest-DeleteServersTestJSON-1394055294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-53c4dbb4-6e0f-407e-8190-73545bb17ec0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:05:36 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-53c4dbb4-6e0f-407e-8190-73545bb17ec0 Jul 03 01:05:36 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:05:36 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Jul 03 01:05:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0241ef67-5188-477a-9487-406d4962ce4d 1073741824" returned: 0 in 1.134s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:05:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0241ef67-5188-477a-9487-406d4962ce4d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:05:36 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0241ef67-5188-477a-9487-406d4962ce4d Jul 03 01:05:36 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:05:37 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Jul 03 01:05:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9890caa1-be66-4067-abdf-3739a6ff08f5 tempest-DeleteServersTestJSON-1394055294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-53c4dbb4-6e0f-407e-8190-73545bb17ec0" returned: 0 in 0.902s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:05:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9890caa1-be66-4067-abdf-3739a6ff08f5 tempest-DeleteServersTestJSON-1394055294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-53c4dbb4-6e0f-407e-8190-73545bb17ec0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:05:37 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-53c4dbb4-6e0f-407e-8190-73545bb17ec0 Jul 03 01:05:37 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:05:37 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Jul 03 01:05:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0241ef67-5188-477a-9487-406d4962ce4d" returned: 0 in 0.853s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:05:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] <== create_volume: return (2035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:05:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:05:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (497d9a03-23ed-4035-a9cb-65d9cf6a4179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0241ef67-5188-477a-9487-406d4962ce4d', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:05:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7dcd53b-2ac3-43fa-bc52-17ac1b246bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:05:37 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Volume volume-0241ef67-5188-477a-9487-406d4962ce4d (0241ef67-5188-477a-9487-406d4962ce4d): created successfully Jul 03 01:05:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7dcd53b-2ac3-43fa-bc52-17ac1b246bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:05:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Flow 'volume_create_manager' (241cd944-d499-41d1-a5e2-67ad77ac89cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:05:37 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-56f9da70-7f95-4d40-a927-6ade2bd20fb5 req-0ca2b06c-5db7-44d4-b6a0-8f9611e0999a tempest-VolumesGetTestJSON-492741645 None] Created volume successfully. Jul 03 01:05:38 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Jul 03 01:05:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9890caa1-be66-4067-abdf-3739a6ff08f5 tempest-DeleteServersTestJSON-1394055294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-53c4dbb4-6e0f-407e-8190-73545bb17ec0" returned: 0 in 0.748s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:05:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9890caa1-be66-4067-abdf-3739a6ff08f5 tempest-DeleteServersTestJSON-1394055294 None] Lock "cinder-quobyte-53c4dbb4-6e0f-407e-8190-73545bb17ec0" released by "delete_volume" :: held 1.710s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:05:38 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-9890caa1-be66-4067-abdf-3739a6ff08f5 tempest-DeleteServersTestJSON-1394055294 None] Created reservations ['d476db05-fa3d-4a9c-88e6-204e03f9e670', 'db807c83-2998-4990-9f8d-aed09d522196', 'aceb2253-2c2c-45a6-8bff-e3a1b235a6c1', 'add697a9-019c-4f25-8316-81fc7bcd8995'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:05:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9890caa1-be66-4067-abdf-3739a6ff08f5 tempest-DeleteServersTestJSON-1394055294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:05:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9890caa1-be66-4067-abdf-3739a6ff08f5 tempest-DeleteServersTestJSON-1394055294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:05:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9890caa1-be66-4067-abdf-3739a6ff08f5 tempest-DeleteServersTestJSON-1394055294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:05:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9890caa1-be66-4067-abdf-3739a6ff08f5 tempest-DeleteServersTestJSON-1394055294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:05:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9890caa1-be66-4067-abdf-3739a6ff08f5 tempest-DeleteServersTestJSON-1394055294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:05:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9890caa1-be66-4067-abdf-3739a6ff08f5 tempest-DeleteServersTestJSON-1394055294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:05:38 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:05:38 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:05:39 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Jul 03 01:05:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9890caa1-be66-4067-abdf-3739a6ff08f5 tempest-DeleteServersTestJSON-1394055294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.758s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:05:39 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-9890caa1-be66-4067-abdf-3739a6ff08f5 tempest-DeleteServersTestJSON-1394055294 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:05:39 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9890caa1-be66-4067-abdf-3739a6ff08f5 tempest-DeleteServersTestJSON-1394055294 None] Deleted volume successfully. Jul 03 01:05:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9890caa1-be66-4067-abdf-3739a6ff08f5 tempest-DeleteServersTestJSON-1394055294 None] Lock "cinder-53c4dbb4-6e0f-407e-8190-73545bb17ec0-delete_volume" released by "delete_volume" :: held 2.760s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:05:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-756039db-63f8-425e-b62c-acffb8bf70dd req-a916238c-285e-4ffb-827f-98f2f18823af tempest-VolumesGetTestJSON-492741645 None] Acquiring lock "cinder-0241ef67-5188-477a-9487-406d4962ce4d-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:05:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-756039db-63f8-425e-b62c-acffb8bf70dd req-a916238c-285e-4ffb-827f-98f2f18823af tempest-VolumesGetTestJSON-492741645 None] Lock "cinder-0241ef67-5188-477a-9487-406d4962ce4d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:05:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-756039db-63f8-425e-b62c-acffb8bf70dd req-a916238c-285e-4ffb-827f-98f2f18823af tempest-VolumesGetTestJSON-492741645 None] Acquiring lock "cinder-quobyte-0241ef67-5188-477a-9487-406d4962ce4d" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:05:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-756039db-63f8-425e-b62c-acffb8bf70dd req-a916238c-285e-4ffb-827f-98f2f18823af tempest-VolumesGetTestJSON-492741645 None] Lock "cinder-quobyte-0241ef67-5188-477a-9487-406d4962ce4d" acquired by "delete_volume" :: waited 0.069s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:05:39 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4a4f0f-d345-4827-bc2b-a08aa11a9eba]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:05:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-756039db-63f8-425e-b62c-acffb8bf70dd req-a916238c-285e-4ffb-827f-98f2f18823af tempest-VolumesGetTestJSON-492741645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0241ef67-5188-477a-9487-406d4962ce4d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:05:39 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0241ef67-5188-477a-9487-406d4962ce4d Jul 03 01:05:39 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:05:40 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Jul 03 01:05:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-756039db-63f8-425e-b62c-acffb8bf70dd req-a916238c-285e-4ffb-827f-98f2f18823af tempest-VolumesGetTestJSON-492741645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0241ef67-5188-477a-9487-406d4962ce4d" returned: 0 in 1.457s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:05:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-756039db-63f8-425e-b62c-acffb8bf70dd req-a916238c-285e-4ffb-827f-98f2f18823af tempest-VolumesGetTestJSON-492741645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0241ef67-5188-477a-9487-406d4962ce4d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:05:40 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0241ef67-5188-477a-9487-406d4962ce4d Jul 03 01:05:40 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:05:41 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Jul 03 01:05:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-756039db-63f8-425e-b62c-acffb8bf70dd req-a916238c-285e-4ffb-827f-98f2f18823af tempest-VolumesGetTestJSON-492741645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0241ef67-5188-477a-9487-406d4962ce4d" returned: 0 in 0.993s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:05:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-756039db-63f8-425e-b62c-acffb8bf70dd req-a916238c-285e-4ffb-827f-98f2f18823af tempest-VolumesGetTestJSON-492741645 None] Lock "cinder-quobyte-0241ef67-5188-477a-9487-406d4962ce4d" released by "delete_volume" :: held 2.521s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:05:42 devstack cinder-volume[86772]: DEBUG cinder.quota [req-756039db-63f8-425e-b62c-acffb8bf70dd req-a916238c-285e-4ffb-827f-98f2f18823af tempest-VolumesGetTestJSON-492741645 None] Created reservations ['de1c7c9a-10a8-4eea-b5d8-034811ec412a', 'ee747cee-86ff-4acc-ba41-0a2fc83f67b5', '1c03234a-1b72-49cf-9844-d80e8c6e97a9', '4df3686a-3b0e-4966-b711-6dff9b9754c9'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:05:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-756039db-63f8-425e-b62c-acffb8bf70dd req-a916238c-285e-4ffb-827f-98f2f18823af tempest-VolumesGetTestJSON-492741645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:05:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-756039db-63f8-425e-b62c-acffb8bf70dd req-a916238c-285e-4ffb-827f-98f2f18823af tempest-VolumesGetTestJSON-492741645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:05:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-756039db-63f8-425e-b62c-acffb8bf70dd req-a916238c-285e-4ffb-827f-98f2f18823af tempest-VolumesGetTestJSON-492741645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:05:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-756039db-63f8-425e-b62c-acffb8bf70dd req-a916238c-285e-4ffb-827f-98f2f18823af tempest-VolumesGetTestJSON-492741645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:05:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-756039db-63f8-425e-b62c-acffb8bf70dd req-a916238c-285e-4ffb-827f-98f2f18823af tempest-VolumesGetTestJSON-492741645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:05:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-756039db-63f8-425e-b62c-acffb8bf70dd req-a916238c-285e-4ffb-827f-98f2f18823af tempest-VolumesGetTestJSON-492741645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:05:42 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:05:42 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:05:43 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Jul 03 01:05:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-756039db-63f8-425e-b62c-acffb8bf70dd req-a916238c-285e-4ffb-827f-98f2f18823af tempest-VolumesGetTestJSON-492741645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.167s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:05:43 devstack cinder-volume[86772]: DEBUG cinder.manager [req-756039db-63f8-425e-b62c-acffb8bf70dd req-a916238c-285e-4ffb-827f-98f2f18823af tempest-VolumesGetTestJSON-492741645 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:05:43 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-756039db-63f8-425e-b62c-acffb8bf70dd req-a916238c-285e-4ffb-827f-98f2f18823af tempest-VolumesGetTestJSON-492741645 None] Deleted volume successfully. Jul 03 01:05:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-756039db-63f8-425e-b62c-acffb8bf70dd req-a916238c-285e-4ffb-827f-98f2f18823af tempest-VolumesGetTestJSON-492741645 None] Lock "cinder-0241ef67-5188-477a-9487-406d4962ce4d-delete_volume" released by "delete_volume" :: held 4.303s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:05:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-bb32a7af-6af5-4557-821d-16f15e1cd971 req-d91bc344-c1ac-4b33-bb9a-dfc0998710fe tempest-ServerActionsTestOtherA-324537631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:05:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-bb32a7af-6af5-4557-821d-16f15e1cd971 req-d91bc344-c1ac-4b33-bb9a-dfc0998710fe tempest-ServerActionsTestOtherA-324537631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:05:50 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d83e13-e714-4a66-b978-9dbd41a1bad0]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:05:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-bb32a7af-6af5-4557-821d-16f15e1cd971 req-d91bc344-c1ac-4b33-bb9a-dfc0998710fe tempest-ServerActionsTestOtherA-324537631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1f00f2b1-6cfd-4256-9b64-01eb76959ff9 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:05:50 devstack sudo[90482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1f00f2b1-6cfd-4256-9b64-01eb76959ff9 Jul 03 01:05:50 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:05:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0906593d-7067-4e8d-bb8b-c9fe296036c4 tempest-BackendsCapabilitiesAdminTestsJSON-1612355259 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86772) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 03 01:05:50 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root Jul 03 01:05:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-bb32a7af-6af5-4557-821d-16f15e1cd971 req-d91bc344-c1ac-4b33-bb9a-dfc0998710fe tempest-ServerActionsTestOtherA-324537631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1f00f2b1-6cfd-4256-9b64-01eb76959ff9" returned: 0 in 0.841s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:05:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-bb32a7af-6af5-4557-821d-16f15e1cd971 req-d91bc344-c1ac-4b33-bb9a-dfc0998710fe tempest-ServerActionsTestOtherA-324537631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.861s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:05:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-bb32a7af-6af5-4557-821d-16f15e1cd971 req-d91bc344-c1ac-4b33-bb9a-dfc0998710fe tempest-ServerActionsTestOtherA-324537631 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171', 'name': 'volume-1f00f2b1-6cfd-4256-9b64-01eb76959ff9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4414694b-9028-4aab-8485-591bd6af7aa2', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:05:50 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-bb32a7af-6af5-4557-821d-16f15e1cd971 req-d91bc344-c1ac-4b33-bb9a-dfc0998710fe tempest-ServerActionsTestOtherA-324537631 None] attachment_update completed successfully. Jul 03 01:05:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-04b4f9d9-34a0-4602-8082-a0bb84890fda tempest-BackendsCapabilitiesAdminTestsJSON-1612355259 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86772) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 03 01:06:00 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=17,cinder:UPDATE=18,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:06:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-2b4cf2bd-9c61-498b-a655-e482e52e5a04 req-23c5c147-3d90-4260-897c-2141703baed4 tempest-ServerActionsTestOtherA-324537631 None] Terminate volume connection completed successfully. Jul 03 01:06:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-2b4cf2bd-9c61-498b-a655-e482e52e5a04 req-23c5c147-3d90-4260-897c-2141703baed4 tempest-ServerActionsTestOtherA-324537631 None] Deleting attachment 4414694b-9028-4aab-8485-591bd6af7aa2. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:06:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-2b4cf2bd-9c61-498b-a655-e482e52e5a04 req-2f4e6f21-78fe-4d38-bed0-a4fa36e3a51d tempest-ServerActionsTestOtherA-324537631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:06:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-2b4cf2bd-9c61-498b-a655-e482e52e5a04 req-2f4e6f21-78fe-4d38-bed0-a4fa36e3a51d tempest-ServerActionsTestOtherA-324537631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:06:04 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9b762d-aeb1-46d5-8433-a5ba525d2be9]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:06:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-2b4cf2bd-9c61-498b-a655-e482e52e5a04 req-2f4e6f21-78fe-4d38-bed0-a4fa36e3a51d tempest-ServerActionsTestOtherA-324537631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1f00f2b1-6cfd-4256-9b64-01eb76959ff9 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:04 devstack sudo[91109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1f00f2b1-6cfd-4256-9b64-01eb76959ff9 Jul 03 01:06:04 devstack sudo[91109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:05 devstack sudo[91109]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-2b4cf2bd-9c61-498b-a655-e482e52e5a04 req-2f4e6f21-78fe-4d38-bed0-a4fa36e3a51d tempest-ServerActionsTestOtherA-324537631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1f00f2b1-6cfd-4256-9b64-01eb76959ff9" returned: 0 in 1.055s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-2b4cf2bd-9c61-498b-a655-e482e52e5a04 req-2f4e6f21-78fe-4d38-bed0-a4fa36e3a51d tempest-ServerActionsTestOtherA-324537631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.081s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-2b4cf2bd-9c61-498b-a655-e482e52e5a04 req-2f4e6f21-78fe-4d38-bed0-a4fa36e3a51d tempest-ServerActionsTestOtherA-324537631 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171', 'name': 'volume-1f00f2b1-6cfd-4256-9b64-01eb76959ff9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '712eb27c-9813-4a70-be8c-04ca4faa809b', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:06:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-2b4cf2bd-9c61-498b-a655-e482e52e5a04 req-2f4e6f21-78fe-4d38-bed0-a4fa36e3a51d tempest-ServerActionsTestOtherA-324537631 None] attachment_update completed successfully. Jul 03 01:06:06 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:06:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Flow 'volume_create_manager' (8725d9dc-780e-498d-b2ad-9be5caf5d8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:06:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4221b47c-64d4-4226-98da-c7bce05a9c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4221b47c-64d4-4226-98da-c7bce05a9c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-897601242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5ea2d3-d976-46ef-9d23-710ffa6ee698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de47560dc989459d98bc2c9e3be177b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:06:07Z,use_quota=True,user_id='866cd83432774de28dad41357c42599e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a12674-d3c4-4959-963f-0fe00e8e96c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a12674-d3c4-4959-963f-0fe00e8e96c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd20df93-27f7-470c-bb0e-c10223210722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd20df93-27f7-470c-bb0e-c10223210722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c5ea2d3-d976-46ef-9d23-710ffa6ee698', 'volume_name': 'volume-4c5ea2d3-d976-46ef-9d23-710ffa6ee698', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e5fa8b-4a16-48a3-8d44-f215f1083e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e5fa8b-4a16-48a3-8d44-f215f1083e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f583d1a-8c82-49cd-b8d1-6d9bb720764c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:06 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Volume 4c5ea2d3-d976-46ef-9d23-710ffa6ee698: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c5ea2d3-d976-46ef-9d23-710ffa6ee698', 'volume_size': 1} Jul 03 01:06:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:06:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:06:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-897601242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5ea2d3-d976-46ef-9d23-710ffa6ee698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de47560dc989459d98bc2c9e3be177b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:06:07Z,use_quota=True,user_id='866cd83432774de28dad41357c42599e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:06:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Creating volume 4c5ea2d3-d976-46ef-9d23-710ffa6ee698 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:06:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:06:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:06:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:06:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:06:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:06:06 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:06:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4c5ea2d3-d976-46ef-9d23-710ffa6ee698 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:06 devstack sudo[91115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4c5ea2d3-d976-46ef-9d23-710ffa6ee698 1073741824 Jul 03 01:06:06 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:08 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4c5ea2d3-d976-46ef-9d23-710ffa6ee698 1073741824" returned: 0 in 1.230s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4c5ea2d3-d976-46ef-9d23-710ffa6ee698 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:08 devstack sudo[91137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4c5ea2d3-d976-46ef-9d23-710ffa6ee698 Jul 03 01:06:08 devstack sudo[91137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Flow 'volume_create_manager' (215fcf64-63a3-4353-b9b7-2f31f334a457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d6672f-ea41-4822-8571-f24b02c43289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:09 devstack sudo[91137]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4c5ea2d3-d976-46ef-9d23-710ffa6ee698" returned: 0 in 0.829s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] <== create_volume: return (2133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.136s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d6672f-ea41-4822-8571-f24b02c43289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1015589570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330645af-15c6-463d-b52d-4acb84976319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f0ae89159e74a2ab5f2b2c835444c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:06:09Z,use_quota=True,user_id='035c9dba44ef4031af3d8aee40756582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96bfd73f-2659-49ac-8b2a-d50605fcdd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96bfd73f-2659-49ac-8b2a-d50605fcdd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b3887d-fbd1-4670-acbf-47bd069bd367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b3887d-fbd1-4670-acbf-47bd069bd367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '330645af-15c6-463d-b52d-4acb84976319', 'volume_name': 'volume-330645af-15c6-463d-b52d-4acb84976319', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c556e8a6-8fe9-4491-890c-e8dda07700c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c556e8a6-8fe9-4491-890c-e8dda07700c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8095538f-6330-4f02-a44d-9e6be5392088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:09 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Volume 330645af-15c6-463d-b52d-4acb84976319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-330645af-15c6-463d-b52d-4acb84976319', 'volume_size': 1} Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1015589570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330645af-15c6-463d-b52d-4acb84976319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f0ae89159e74a2ab5f2b2c835444c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:06:09Z,use_quota=True,user_id='035c9dba44ef4031af3d8aee40756582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Creating volume 330645af-15c6-463d-b52d-4acb84976319 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:06:09 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-330645af-15c6-463d-b52d-4acb84976319 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f583d1a-8c82-49cd-b8d1-6d9bb720764c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c5ea2d3-d976-46ef-9d23-710ffa6ee698', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47545dc-3bc3-4792-9bfc-44ce5bb079c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:09 devstack sudo[91207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-330645af-15c6-463d-b52d-4acb84976319 1073741824 Jul 03 01:06:09 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:09 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Volume volume-4c5ea2d3-d976-46ef-9d23-710ffa6ee698 (4c5ea2d3-d976-46ef-9d23-710ffa6ee698): created successfully Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47545dc-3bc3-4792-9bfc-44ce5bb079c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Flow 'volume_create_manager' (8725d9dc-780e-498d-b2ad-9be5caf5d8a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:06:09 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f59725a8-a746-498f-8f1f-a8daee7bf807 tempest-ServersNegativeTestJSON-1965827573 None] Created volume successfully. Jul 03 01:06:10 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-330645af-15c6-463d-b52d-4acb84976319 1073741824" returned: 0 in 0.873s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-330645af-15c6-463d-b52d-4acb84976319 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:10 devstack sudo[91216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-330645af-15c6-463d-b52d-4acb84976319 Jul 03 01:06:10 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:10 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-330645af-15c6-463d-b52d-4acb84976319" returned: 0 in 0.732s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:06:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8095538f-6330-4f02-a44d-9e6be5392088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-330645af-15c6-463d-b52d-4acb84976319', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d07d862-947c-48a4-a566-027cad76024e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:10 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Volume volume-330645af-15c6-463d-b52d-4acb84976319 (330645af-15c6-463d-b52d-4acb84976319): created successfully Jul 03 01:06:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d07d862-947c-48a4-a566-027cad76024e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Flow 'volume_create_manager' (215fcf64-63a3-4353-b9b7-2f31f334a457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:06:10 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-331e1dea-98cc-4ad1-842f-463c9e46b676 tempest-VolumesServicesTestJSON-1017944308 None] Created volume successfully. Jul 03 01:06:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-acfa6cb4-def8-42ae-8b2b-dd4dcdc4efcf tempest-VolumesServicesTestJSON-1017944308 None] Acquiring lock "cinder-330645af-15c6-463d-b52d-4acb84976319-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:06:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-acfa6cb4-def8-42ae-8b2b-dd4dcdc4efcf tempest-VolumesServicesTestJSON-1017944308 None] Lock "cinder-330645af-15c6-463d-b52d-4acb84976319-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:06:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-acfa6cb4-def8-42ae-8b2b-dd4dcdc4efcf tempest-VolumesServicesTestJSON-1017944308 None] Acquiring lock "cinder-quobyte-330645af-15c6-463d-b52d-4acb84976319" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:06:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-acfa6cb4-def8-42ae-8b2b-dd4dcdc4efcf tempest-VolumesServicesTestJSON-1017944308 None] Lock "cinder-quobyte-330645af-15c6-463d-b52d-4acb84976319" acquired by "delete_volume" :: waited 0.041s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:06:11 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[069f3432-6a5b-4dc8-9dd9-b1a029b725d9]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:06:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-acfa6cb4-def8-42ae-8b2b-dd4dcdc4efcf tempest-VolumesServicesTestJSON-1017944308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-330645af-15c6-463d-b52d-4acb84976319 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:11 devstack sudo[91562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-330645af-15c6-463d-b52d-4acb84976319 Jul 03 01:06:11 devstack sudo[91562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Flow 'volume_create_manager' (6c2e0f87-f33e-44a2-9100-f9be1b7591b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d3ed5c2-9dab-46a7-ab4d-4703b2368934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d3ed5c2-9dab-46a7-ab4d-4703b2368934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1383202801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40192a01-7262-4d75-a242-2e37171b4bd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de47560dc989459d98bc2c9e3be177b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:06:12Z,use_quota=True,user_id='866cd83432774de28dad41357c42599e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c0c6390-2f9c-4d3e-a853-7e5ed916fa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c0c6390-2f9c-4d3e-a853-7e5ed916fa89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb3139c-f890-4b65-8f97-eb386da3e26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb3139c-f890-4b65-8f97-eb386da3e26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40192a01-7262-4d75-a242-2e37171b4bd5', 'volume_name': 'volume-40192a01-7262-4d75-a242-2e37171b4bd5', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee5bcd65-e6e0-40e8-a17f-4dedf80a0c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee5bcd65-e6e0-40e8-a17f-4dedf80a0c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa8262f0-f9f4-4d74-9d33-d86cabb85122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:12 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Volume 40192a01-7262-4d75-a242-2e37171b4bd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40192a01-7262-4d75-a242-2e37171b4bd5', 'volume_size': 1} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1383202801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40192a01-7262-4d75-a242-2e37171b4bd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de47560dc989459d98bc2c9e3be177b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:06:12Z,use_quota=True,user_id='866cd83432774de28dad41357c42599e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Creating volume 40192a01-7262-4d75-a242-2e37171b4bd5 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:06:12 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-40192a01-7262-4d75-a242-2e37171b4bd5 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:12 devstack sudo[91583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-40192a01-7262-4d75-a242-2e37171b4bd5 1073741824 Jul 03 01:06:12 devstack sudo[91583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:12 devstack sudo[91589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:06:12 devstack sudo[91589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:12 devstack sudo[91562]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-acfa6cb4-def8-42ae-8b2b-dd4dcdc4efcf tempest-VolumesServicesTestJSON-1017944308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-330645af-15c6-463d-b52d-4acb84976319" returned: 0 in 1.271s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-acfa6cb4-def8-42ae-8b2b-dd4dcdc4efcf tempest-VolumesServicesTestJSON-1017944308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-330645af-15c6-463d-b52d-4acb84976319 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:12 devstack sudo[91591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-330645af-15c6-463d-b52d-4acb84976319 Jul 03 01:06:12 devstack sudo[91591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:13 devstack sudo[91583]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-40192a01-7262-4d75-a242-2e37171b4bd5 1073741824" returned: 0 in 1.165s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:13 devstack sudo[91589]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.770s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:06:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-40192a01-7262-4d75-a242-2e37171b4bd5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:13 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:06:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 8 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:06:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:06:13 devstack sudo[91602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-40192a01-7262-4d75-a242-2e37171b4bd5 Jul 03 01:06:13 devstack sudo[91602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:14 devstack sudo[91591]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-acfa6cb4-def8-42ae-8b2b-dd4dcdc4efcf tempest-VolumesServicesTestJSON-1017944308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-330645af-15c6-463d-b52d-4acb84976319" returned: 0 in 1.157s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-acfa6cb4-def8-42ae-8b2b-dd4dcdc4efcf tempest-VolumesServicesTestJSON-1017944308 None] Lock "cinder-quobyte-330645af-15c6-463d-b52d-4acb84976319" released by "delete_volume" :: held 2.518s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:06:14 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-acfa6cb4-def8-42ae-8b2b-dd4dcdc4efcf tempest-VolumesServicesTestJSON-1017944308 None] Created reservations ['c6c361b2-3d8e-4254-b814-669c5fc13c16', '96480845-0b7d-42cd-80d8-f2846bc40e45', 'a420ba24-8e91-4fee-8494-a15d322215c8', '0e0166a0-4f11-46ec-aa90-063ce22717a9'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:06:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-acfa6cb4-def8-42ae-8b2b-dd4dcdc4efcf tempest-VolumesServicesTestJSON-1017944308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:06:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-acfa6cb4-def8-42ae-8b2b-dd4dcdc4efcf tempest-VolumesServicesTestJSON-1017944308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:06:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-acfa6cb4-def8-42ae-8b2b-dd4dcdc4efcf tempest-VolumesServicesTestJSON-1017944308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:06:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-acfa6cb4-def8-42ae-8b2b-dd4dcdc4efcf tempest-VolumesServicesTestJSON-1017944308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:06:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-acfa6cb4-def8-42ae-8b2b-dd4dcdc4efcf tempest-VolumesServicesTestJSON-1017944308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-acfa6cb4-def8-42ae-8b2b-dd4dcdc4efcf tempest-VolumesServicesTestJSON-1017944308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:14 devstack sudo[91606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:06:14 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:14 devstack sudo[91602]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-40192a01-7262-4d75-a242-2e37171b4bd5" returned: 0 in 1.036s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] <== create_volume: return (2273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:06:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.276s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa8262f0-f9f4-4d74-9d33-d86cabb85122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40192a01-7262-4d75-a242-2e37171b4bd5', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd4ac26-efc7-45bd-93a3-5d70eb53abaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:14 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Volume volume-40192a01-7262-4d75-a242-2e37171b4bd5 (40192a01-7262-4d75-a242-2e37171b4bd5): created successfully Jul 03 01:06:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd4ac26-efc7-45bd-93a3-5d70eb53abaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Flow 'volume_create_manager' (6c2e0f87-f33e-44a2-9100-f9be1b7591b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:06:14 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-10e77dda-7190-4a43-a9e3-e55e02322d39 tempest-ServersNegativeTestJSON-1965827573 None] Created volume successfully. Jul 03 01:06:14 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-acfa6cb4-def8-42ae-8b2b-dd4dcdc4efcf tempest-VolumesServicesTestJSON-1017944308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.713s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:14 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-acfa6cb4-def8-42ae-8b2b-dd4dcdc4efcf tempest-VolumesServicesTestJSON-1017944308 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:06:14 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-acfa6cb4-def8-42ae-8b2b-dd4dcdc4efcf tempest-VolumesServicesTestJSON-1017944308 None] Deleted volume successfully. Jul 03 01:06:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-acfa6cb4-def8-42ae-8b2b-dd4dcdc4efcf tempest-VolumesServicesTestJSON-1017944308 None] Lock "cinder-330645af-15c6-463d-b52d-4acb84976319-delete_volume" released by "delete_volume" :: held 3.610s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:06:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5fc18689-6b07-45a3-8bfc-04cdffdc666b tempest-ServersNegativeTestJSON-1965827573 None] Acquiring lock "cinder-40192a01-7262-4d75-a242-2e37171b4bd5-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:06:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5fc18689-6b07-45a3-8bfc-04cdffdc666b tempest-ServersNegativeTestJSON-1965827573 None] Lock "cinder-40192a01-7262-4d75-a242-2e37171b4bd5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:06:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5fc18689-6b07-45a3-8bfc-04cdffdc666b tempest-ServersNegativeTestJSON-1965827573 None] Acquiring lock "cinder-quobyte-40192a01-7262-4d75-a242-2e37171b4bd5" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:06:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5fc18689-6b07-45a3-8bfc-04cdffdc666b tempest-ServersNegativeTestJSON-1965827573 None] Lock "cinder-quobyte-40192a01-7262-4d75-a242-2e37171b4bd5" acquired by "delete_volume" :: waited 0.037s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:06:16 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd8d4c9-db44-4b8c-9c58-6d560848d84e]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:06:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5fc18689-6b07-45a3-8bfc-04cdffdc666b tempest-ServersNegativeTestJSON-1965827573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-40192a01-7262-4d75-a242-2e37171b4bd5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:17 devstack sudo[91610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-40192a01-7262-4d75-a242-2e37171b4bd5 Jul 03 01:06:17 devstack sudo[91610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:18 devstack sudo[91610]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5fc18689-6b07-45a3-8bfc-04cdffdc666b tempest-ServersNegativeTestJSON-1965827573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-40192a01-7262-4d75-a242-2e37171b4bd5" returned: 0 in 1.467s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5fc18689-6b07-45a3-8bfc-04cdffdc666b tempest-ServersNegativeTestJSON-1965827573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-40192a01-7262-4d75-a242-2e37171b4bd5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:18 devstack sudo[91620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-40192a01-7262-4d75-a242-2e37171b4bd5 Jul 03 01:06:18 devstack sudo[91620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:19 devstack sudo[91620]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5fc18689-6b07-45a3-8bfc-04cdffdc666b tempest-ServersNegativeTestJSON-1965827573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-40192a01-7262-4d75-a242-2e37171b4bd5" returned: 0 in 1.219s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5fc18689-6b07-45a3-8bfc-04cdffdc666b tempest-ServersNegativeTestJSON-1965827573 None] Lock "cinder-quobyte-40192a01-7262-4d75-a242-2e37171b4bd5" released by "delete_volume" :: held 2.755s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:06:19 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-5fc18689-6b07-45a3-8bfc-04cdffdc666b tempest-ServersNegativeTestJSON-1965827573 None] Created reservations ['06e895a2-795e-405c-bd58-40fe64fde031', '40d9c5ef-ca24-4732-be61-fb2282c6855d', '1103b96d-bcb6-4186-9d59-f74fbc3e5b63', 'a256b09b-e0a1-4b05-b92d-826839d05ca6'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:06:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5fc18689-6b07-45a3-8bfc-04cdffdc666b tempest-ServersNegativeTestJSON-1965827573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:06:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5fc18689-6b07-45a3-8bfc-04cdffdc666b tempest-ServersNegativeTestJSON-1965827573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:06:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5fc18689-6b07-45a3-8bfc-04cdffdc666b tempest-ServersNegativeTestJSON-1965827573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:06:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5fc18689-6b07-45a3-8bfc-04cdffdc666b tempest-ServersNegativeTestJSON-1965827573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:06:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5fc18689-6b07-45a3-8bfc-04cdffdc666b tempest-ServersNegativeTestJSON-1965827573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5fc18689-6b07-45a3-8bfc-04cdffdc666b tempest-ServersNegativeTestJSON-1965827573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:19 devstack sudo[91636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:06:19 devstack sudo[91636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e1da8ce2-a7c2-4f49-a619-253caac1362f tempest-ServersNegativeTestJSON-1965827573 None] Acquiring lock "cinder-4c5ea2d3-d976-46ef-9d23-710ffa6ee698-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:06:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e1da8ce2-a7c2-4f49-a619-253caac1362f tempest-ServersNegativeTestJSON-1965827573 None] Lock "cinder-4c5ea2d3-d976-46ef-9d23-710ffa6ee698-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:06:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e1da8ce2-a7c2-4f49-a619-253caac1362f tempest-ServersNegativeTestJSON-1965827573 None] Acquiring lock "cinder-quobyte-4c5ea2d3-d976-46ef-9d23-710ffa6ee698" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:06:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e1da8ce2-a7c2-4f49-a619-253caac1362f tempest-ServersNegativeTestJSON-1965827573 None] Lock "cinder-quobyte-4c5ea2d3-d976-46ef-9d23-710ffa6ee698" acquired by "delete_volume" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:06:20 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2728c79b-fc9f-43db-adcc-b2656217ff1b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:06:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e1da8ce2-a7c2-4f49-a619-253caac1362f tempest-ServersNegativeTestJSON-1965827573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4c5ea2d3-d976-46ef-9d23-710ffa6ee698 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:20 devstack sudo[91636]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5fc18689-6b07-45a3-8bfc-04cdffdc666b tempest-ServersNegativeTestJSON-1965827573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.008s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:20 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-5fc18689-6b07-45a3-8bfc-04cdffdc666b tempest-ServersNegativeTestJSON-1965827573 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:06:20 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5fc18689-6b07-45a3-8bfc-04cdffdc666b tempest-ServersNegativeTestJSON-1965827573 None] Deleted volume successfully. Jul 03 01:06:20 devstack sudo[91638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4c5ea2d3-d976-46ef-9d23-710ffa6ee698 Jul 03 01:06:20 devstack sudo[91638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5fc18689-6b07-45a3-8bfc-04cdffdc666b tempest-ServersNegativeTestJSON-1965827573 None] Lock "cinder-40192a01-7262-4d75-a242-2e37171b4bd5-delete_volume" released by "delete_volume" :: held 4.081s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:06:21 devstack sudo[91638]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e1da8ce2-a7c2-4f49-a619-253caac1362f tempest-ServersNegativeTestJSON-1965827573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4c5ea2d3-d976-46ef-9d23-710ffa6ee698" returned: 0 in 1.077s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e1da8ce2-a7c2-4f49-a619-253caac1362f tempest-ServersNegativeTestJSON-1965827573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4c5ea2d3-d976-46ef-9d23-710ffa6ee698 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:21 devstack sudo[91646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4c5ea2d3-d976-46ef-9d23-710ffa6ee698 Jul 03 01:06:21 devstack sudo[91646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:22 devstack sudo[91646]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e1da8ce2-a7c2-4f49-a619-253caac1362f tempest-ServersNegativeTestJSON-1965827573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4c5ea2d3-d976-46ef-9d23-710ffa6ee698" returned: 0 in 0.794s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e1da8ce2-a7c2-4f49-a619-253caac1362f tempest-ServersNegativeTestJSON-1965827573 None] Lock "cinder-quobyte-4c5ea2d3-d976-46ef-9d23-710ffa6ee698" released by "delete_volume" :: held 1.936s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:06:22 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e1da8ce2-a7c2-4f49-a619-253caac1362f tempest-ServersNegativeTestJSON-1965827573 None] Created reservations ['5ac40229-abb1-4bfc-8eb2-d629fe4cf61d', '732a34d9-7771-4896-9301-10fc5079b542', '3b5cb98a-0a7b-4527-9388-d86b2caa3353', '9eb80ba5-1db0-4836-8ff2-783ccd6c5b1b'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:06:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e1da8ce2-a7c2-4f49-a619-253caac1362f tempest-ServersNegativeTestJSON-1965827573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:06:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e1da8ce2-a7c2-4f49-a619-253caac1362f tempest-ServersNegativeTestJSON-1965827573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:06:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e1da8ce2-a7c2-4f49-a619-253caac1362f tempest-ServersNegativeTestJSON-1965827573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:06:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e1da8ce2-a7c2-4f49-a619-253caac1362f tempest-ServersNegativeTestJSON-1965827573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:06:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e1da8ce2-a7c2-4f49-a619-253caac1362f tempest-ServersNegativeTestJSON-1965827573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e1da8ce2-a7c2-4f49-a619-253caac1362f tempest-ServersNegativeTestJSON-1965827573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:22 devstack sudo[91655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:06:22 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:23 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e1da8ce2-a7c2-4f49-a619-253caac1362f tempest-ServersNegativeTestJSON-1965827573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.827s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:23 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-e1da8ce2-a7c2-4f49-a619-253caac1362f tempest-ServersNegativeTestJSON-1965827573 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:06:23 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e1da8ce2-a7c2-4f49-a619-253caac1362f tempest-ServersNegativeTestJSON-1965827573 None] Deleted volume successfully. Jul 03 01:06:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e1da8ce2-a7c2-4f49-a619-253caac1362f tempest-ServersNegativeTestJSON-1965827573 None] Lock "cinder-4c5ea2d3-d976-46ef-9d23-710ffa6ee698-delete_volume" released by "delete_volume" :: held 3.216s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:06:32 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=23,cinder:UPDATE=34,cinder:INSERT=8,cinder:DELETE=3 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:06:33 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=53,cinder:UPDATE=59,cinder:INSERT=12,cinder:DELETE=4 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:06:40 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-20df3ce3-766d-4f22-bd73-15aff86a04af req-ab29f391-9730-4215-8500-5a562f54c5f4 tempest-ServerActionsTestOtherA-324537631 None] Terminate volume connection completed successfully. Jul 03 01:06:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-20df3ce3-766d-4f22-bd73-15aff86a04af req-ab29f391-9730-4215-8500-5a562f54c5f4 tempest-ServerActionsTestOtherA-324537631 None] Deleting attachment 712eb27c-9813-4a70-be8c-04ca4faa809b. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:06:49 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-495b75d5-ce86-416d-b6ab-232b932d72b5 tempest-GroupsTest-598714453 None] Group tempest-Group1-1503909870: creating Jul 03 01:06:49 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-495b75d5-ce86-416d-b6ab-232b932d72b5 tempest-GroupsTest-598714453 None] Group tempest-Group1-1503909870: created successfully Jul 03 01:06:49 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-495b75d5-ce86-416d-b6ab-232b932d72b5 tempest-GroupsTest-598714453 None] Create group completed successfully. Jul 03 01:06:50 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4f2abcd2-8baf-48dd-99cf-f83c1a4376bb tempest-GroupsTest-598714453 None] Group tempest-Group2-1847632803: creating Jul 03 01:06:50 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4f2abcd2-8baf-48dd-99cf-f83c1a4376bb tempest-GroupsTest-598714453 None] Group tempest-Group2-1847632803: created successfully Jul 03 01:06:50 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4f2abcd2-8baf-48dd-99cf-f83c1a4376bb tempest-GroupsTest-598714453 None] Create group completed successfully. Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fc4d2168-bf1c-43f5-b2eb-ac2dc7b62f07 tempest-ServerActionsTestOtherA-324537631 None] Acquiring lock "cinder-1f00f2b1-6cfd-4256-9b64-01eb76959ff9-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fc4d2168-bf1c-43f5-b2eb-ac2dc7b62f07 tempest-ServerActionsTestOtherA-324537631 None] Lock "cinder-1f00f2b1-6cfd-4256-9b64-01eb76959ff9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Flow 'volume_create_manager' (6449b1f6-0534-42d5-a3d7-829f863678a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542f7644-01c8-4c15-9750-fd82921cf38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542f7644-01c8-4c15-9750-fd82921cf38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1002223337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b133f094add64e44ad5d3ccb72702669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:06:51Z,use_quota=True,user_id='a01d34fd8c344fc8bcb23ceb706c3b14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe03a780-0238-454b-8290-ed385be260e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe03a780-0238-454b-8290-ed385be260e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e3928d-f740-4c7a-a219-8dd8b9ec95ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e3928d-f740-4c7a-a219-8dd8b9ec95ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4', 'volume_name': 'volume-b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d255ecf2-89db-4b8d-82db-58df63b3a852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d255ecf2-89db-4b8d-82db-58df63b3a852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c3ef2a-c32a-456c-9511-75e95dfd51cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:51 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Volume b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4', 'volume_size': 1} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1002223337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b133f094add64e44ad5d3ccb72702669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:06:51Z,use_quota=True,user_id='a01d34fd8c344fc8bcb23ceb706c3b14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Creating volume b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:06:51 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fc4d2168-bf1c-43f5-b2eb-ac2dc7b62f07 tempest-ServerActionsTestOtherA-324537631 None] Acquiring lock "cinder-quobyte-1f00f2b1-6cfd-4256-9b64-01eb76959ff9" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:06:51 devstack sudo[91909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4 1073741824 Jul 03 01:06:51 devstack sudo[91909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fc4d2168-bf1c-43f5-b2eb-ac2dc7b62f07 tempest-ServerActionsTestOtherA-324537631 None] Lock "cinder-quobyte-1f00f2b1-6cfd-4256-9b64-01eb76959ff9" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[15661e5d-f008-493e-9fbd-ded13e474a37]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc4d2168-bf1c-43f5-b2eb-ac2dc7b62f07 tempest-ServerActionsTestOtherA-324537631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1f00f2b1-6cfd-4256-9b64-01eb76959ff9 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:51 devstack sudo[91911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1f00f2b1-6cfd-4256-9b64-01eb76959ff9 Jul 03 01:06:51 devstack sudo[91911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Flow 'volume_create_manager' (1d09ecda-6912-41bc-bfac-66b2a413a492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a2ec16-e237-47fb-a169-943fa48b2d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a2ec16-e237-47fb-a169-943fa48b2d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2088956226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c741c82b-ad1d-4235-a559-52c749dcfcdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a21421cfe964902b121ff755ddd41b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:06:52Z,use_quota=True,user_id='7fd1fff33dba4a6fb921ba6bcbd1de78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c315167-ee2d-4c1d-a262-84614b19c57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c315167-ee2d-4c1d-a262-84614b19c57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf6db9b-99d9-479d-a522-aca15dac930e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:51 devstack cinder-volume[86772]: DEBUG cinder.image.glance [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Creating Keystone auth plugin from conf {{(pid=86772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 01:06:52 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:06:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Flow 'volume_create_manager' (253d7921-103a-4608-9f68-4cc2aaa34f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:06:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e29d14-ad51-46c7-b208-cd6e2295e473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:52 devstack sudo[91909]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e29d14-ad51-46c7-b208-cd6e2295e473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-910604785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ace7c91-0551-4afc-aff5-9ca511d3fa06,host='devstack@QuobyteHD#QuobyteHD',id=f3a6b06f-d7fb-4367-b502-b5028c5fd798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2136ea67be5b416683f3a84011dab1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:06:52Z,use_quota=True,user_id='e01bafeb3ecd408eab475ceb207438cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e2195dc-0d5d-4871-8491-d57ba8f0a3e0),volume_type_id=2e2195dc-0d5d-4871-8491-d57ba8f0a3e0)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3573bcea-4bfc-44d2-bfa9-c3e4c060671e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:52 devstack sudo[91911]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3573bcea-4bfc-44d2-bfa9-c3e4c060671e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cf877af-7348-400b-b4f4-f598be31814d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cf877af-7348-400b-b4f4-f598be31814d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3a6b06f-d7fb-4367-b502-b5028c5fd798', 'volume_name': 'volume-f3a6b06f-d7fb-4367-b502-b5028c5fd798', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b0529ce-147d-48ff-8efb-c2c2905ce0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b0529ce-147d-48ff-8efb-c2c2905ce0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e2dfbb5-d1ca-4100-9e61-1f49e949ff12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:52 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Volume f3a6b06f-d7fb-4367-b502-b5028c5fd798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3a6b06f-d7fb-4367-b502-b5028c5fd798', 'volume_size': 1} Jul 03 01:06:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:06:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf6db9b-99d9-479d-a522-aca15dac930e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c741c82b-ad1d-4235-a559-52c749dcfcdc', 'volume_name': 'volume-c741c82b-ad1d-4235-a559-52c749dcfcdc', 'volume_size': 1, 'image_id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d536ca8-2cba-4b44-93ed-ed247e842444', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b88b4a33269476b9f6e11e7fe82fb87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'created_at': datetime.datetime(2026, 7, 2, 22, 56, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 56, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d536ca8-2cba-4b44-93ed-ed247e842444/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb18bdfc-0400-4eb7-a2b2-8f992c051a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb18bdfc-0400-4eb7-a2b2-8f992c051a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5a55b4-434f-4f51-801e-b8033d1a98dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:52 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Volume c741c82b-ad1d-4235-a559-52c749dcfcdc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c741c82b-ad1d-4235-a559-52c749dcfcdc', 'volume_size': 1, 'image_id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d536ca8-2cba-4b44-93ed-ed247e842444', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b88b4a33269476b9f6e11e7fe82fb87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'created_at': datetime.datetime(2026, 7, 2, 22, 56, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 56, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d536ca8-2cba-4b44-93ed-ed247e842444/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 01:06:52 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Trying to clone c741c82b-ad1d-4235-a559-52c749dcfcdc from image 3d536ca8-2cba-4b44-93ed-ed247e842444 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3d536ca8-2cba-4b44-93ed-ed247e842444', 'metadata': {}}]). {{(pid=86772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 01:06:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4 1073741824" returned: 0 in 1.221s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc4d2168-bf1c-43f5-b2eb-ac2dc7b62f07 tempest-ServerActionsTestOtherA-324537631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1f00f2b1-6cfd-4256-9b64-01eb76959ff9" returned: 0 in 1.149s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc4d2168-bf1c-43f5-b2eb-ac2dc7b62f07 tempest-ServerActionsTestOtherA-324537631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1f00f2b1-6cfd-4256-9b64-01eb76959ff9 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:52 devstack sudo[91921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1f00f2b1-6cfd-4256-9b64-01eb76959ff9 Jul 03 01:06:52 devstack sudo[91921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:52 devstack sudo[91923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4 Jul 03 01:06:52 devstack sudo[91923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:52 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_3wscu_kzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 01:06:52 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Image download 20.69 MB at 20.69 MB/s Jul 03 01:06:52 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef08991c-8f47-47ab-8f8b-49e219be2726]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:06:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_3wscu_kzdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:53 devstack sudo[91946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_3wscu_kzdevstack@QuobyteHD Jul 03 01:06:53 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:53 devstack sudo[91921]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc4d2168-bf1c-43f5-b2eb-ac2dc7b62f07 tempest-ServerActionsTestOtherA-324537631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1f00f2b1-6cfd-4256-9b64-01eb76959ff9" returned: 0 in 0.756s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fc4d2168-bf1c-43f5-b2eb-ac2dc7b62f07 tempest-ServerActionsTestOtherA-324537631 None] Lock "cinder-quobyte-1f00f2b1-6cfd-4256-9b64-01eb76959ff9" released by "delete_volume" :: held 1.956s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:06:53 devstack sudo[91923]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4" returned: 0 in 0.741s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] <== create_volume: return (2024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.026s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.818s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2ace7c91-0551-4afc-aff5-9ca511d3fa06,created_at=2026-07-02T23:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-910604785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ace7c91-0551-4afc-aff5-9ca511d3fa06,host='devstack@QuobyteHD#QuobyteHD',id=f3a6b06f-d7fb-4367-b502-b5028c5fd798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2136ea67be5b416683f3a84011dab1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:06:52Z,use_quota=True,user_id='e01bafeb3ecd408eab475ceb207438cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e2195dc-0d5d-4871-8491-d57ba8f0a3e0),volume_type_id=2e2195dc-0d5d-4871-8491-d57ba8f0a3e0)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Creating volume f3a6b06f-d7fb-4367-b502-b5028c5fd798 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:06:53 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f3a6b06f-d7fb-4367-b502-b5028c5fd798 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c3ef2a-c32a-456c-9511-75e95dfd51cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55839e9e-f40b-4d07-9071-c6d3fdff3dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:53 devstack sudo[91950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f3a6b06f-d7fb-4367-b502-b5028c5fd798 1073741824 Jul 03 01:06:53 devstack sudo[91950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:53 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Volume volume-b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4 (b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4): created successfully Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55839e9e-f40b-4d07-9071-c6d3fdff3dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Flow 'volume_create_manager' (6449b1f6-0534-42d5-a3d7-829f863678a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:06:53 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3eba5552-cbf1-4db1-ac57-9f44483a6821 tempest-AttachVolumeNegativeTest-1857772135 None] Created volume successfully. Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-fc4d2168-bf1c-43f5-b2eb-ac2dc7b62f07 tempest-ServerActionsTestOtherA-324537631 None] Created reservations ['c8fc5752-079e-4ad4-a458-a616625704cc', '70b98a64-678c-415d-b8a1-f369f0da2eaf', 'a2d03abd-1df5-4546-b9b1-85fc4b25b06a', 'dc0cb9ca-b0a9-4a00-91fc-bef28db6aab5'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fc4d2168-bf1c-43f5-b2eb-ac2dc7b62f07 tempest-ServerActionsTestOtherA-324537631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fc4d2168-bf1c-43f5-b2eb-ac2dc7b62f07 tempest-ServerActionsTestOtherA-324537631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fc4d2168-bf1c-43f5-b2eb-ac2dc7b62f07 tempest-ServerActionsTestOtherA-324537631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fc4d2168-bf1c-43f5-b2eb-ac2dc7b62f07 tempest-ServerActionsTestOtherA-324537631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fc4d2168-bf1c-43f5-b2eb-ac2dc7b62f07 tempest-ServerActionsTestOtherA-324537631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc4d2168-bf1c-43f5-b2eb-ac2dc7b62f07 tempest-ServerActionsTestOtherA-324537631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:53 devstack sudo[91952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:06:53 devstack sudo[91952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:53 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_3wscu_kzdevstack@QuobyteHD" returned: 0 in 0.779s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Temporary image 3d536ca8-2cba-4b44-93ed-ed247e842444 is fetched for user 7fd1fff33dba4a6fb921ba6bcbd1de78. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c879363-dbd1-4ec6-8803-26d09143efdf]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:06:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_3wscu_kzdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:53 devstack sudo[91957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_3wscu_kzdevstack@QuobyteHD Jul 03 01:06:53 devstack sudo[91957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:54 devstack sudo[91952]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc4d2168-bf1c-43f5-b2eb-ac2dc7b62f07 tempest-ServerActionsTestOtherA-324537631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.693s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:54 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-fc4d2168-bf1c-43f5-b2eb-ac2dc7b62f07 tempest-ServerActionsTestOtherA-324537631 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:06:54 devstack sudo[91950]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:54 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-fc4d2168-bf1c-43f5-b2eb-ac2dc7b62f07 tempest-ServerActionsTestOtherA-324537631 None] Deleted volume successfully. Jul 03 01:06:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f3a6b06f-d7fb-4367-b502-b5028c5fd798 1073741824" returned: 0 in 0.895s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-fc4d2168-bf1c-43f5-b2eb-ac2dc7b62f07 tempest-ServerActionsTestOtherA-324537631 None] Lock "cinder-1f00f2b1-6cfd-4256-9b64-01eb76959ff9-delete_volume" released by "delete_volume" :: held 3.077s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:06:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f3a6b06f-d7fb-4367-b502-b5028c5fd798 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:54 devstack sudo[91963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f3a6b06f-d7fb-4367-b502-b5028c5fd798 Jul 03 01:06:54 devstack sudo[91963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:54 devstack sudo[91957]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_3wscu_kzdevstack@QuobyteHD" returned: 0 in 0.799s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:06:55 devstack sudo[91963]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f3a6b06f-d7fb-4367-b502-b5028c5fd798" returned: 0 in 0.691s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:06:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.404s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:06:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2088956226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c741c82b-ad1d-4235-a559-52c749dcfcdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a21421cfe964902b121ff755ddd41b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:06:52Z,use_quota=True,user_id='7fd1fff33dba4a6fb921ba6bcbd1de78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:06:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Creating volume c741c82b-ad1d-4235-a559-52c749dcfcdc {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:06:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:06:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:06:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:06:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:06:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:06:55 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:06:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:55 devstack sudo[91975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc 1073741824 Jul 03 01:06:55 devstack sudo[91975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e2dfbb5-d1ca-4100-9e61-1f49e949ff12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3a6b06f-d7fb-4367-b502-b5028c5fd798', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336d530b-8b15-426d-837d-c580d46c9407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:06:55 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Volume volume-f3a6b06f-d7fb-4367-b502-b5028c5fd798 (f3a6b06f-d7fb-4367-b502-b5028c5fd798): created successfully Jul 03 01:06:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336d530b-8b15-426d-837d-c580d46c9407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:06:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Flow 'volume_create_manager' (253d7921-103a-4608-9f68-4cc2aaa34f71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:06:55 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4f949f4c-b9a5-49bc-aba9-18d09c0cd8fa tempest-GroupsTest-598714453 None] Created volume successfully. Jul 03 01:06:56 devstack sudo[91975]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc 1073741824" returned: 0 in 1.000s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:56 devstack sudo[92021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc Jul 03 01:06:56 devstack sudo[92021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e4d9d74d-4e39-454d-a346-a9f4755d7e3c tempest-GroupsTest-598714453 None] Acquiring lock "cinder-quobyte-f3a6b06f-d7fb-4367-b502-b5028c5fd798" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:06:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e4d9d74d-4e39-454d-a346-a9f4755d7e3c tempest-GroupsTest-598714453 None] Lock "cinder-quobyte-f3a6b06f-d7fb-4367-b502-b5028c5fd798" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:06:57 devstack sudo[92021]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:57 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be977ed-94d2-48d7-8087-d62f02e48d9b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:06:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e4d9d74d-4e39-454d-a346-a9f4755d7e3c tempest-GroupsTest-598714453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f3a6b06f-d7fb-4367-b502-b5028c5fd798 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc" returned: 0 in 0.958s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] <== create_volume: return (2072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:06:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.078s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:57 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Attempting download of 3d536ca8-2cba-4b44-93ed-ed247e842444 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d536ca8-2cba-4b44-93ed-ed247e842444', 'metadata': {}}])) to volume c741c82b-ad1d-4235-a559-52c749dcfcdc. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 01:06:57 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9035552f-3824-41a7-918d-1e4e9b05fcbc]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:06:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_pj7aw541 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:57 devstack sudo[92027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f3a6b06f-d7fb-4367-b502-b5028c5fd798 Jul 03 01:06:57 devstack sudo[92027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:57 devstack sudo[92028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_pj7aw541 Jul 03 01:06:57 devstack sudo[92028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:58 devstack sudo[92028]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_pj7aw541" returned: 0 in 0.935s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_pj7aw541 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:58 devstack sudo[92053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_pj7aw541 Jul 03 01:06:58 devstack sudo[92053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:58 devstack sudo[92027]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e4d9d74d-4e39-454d-a346-a9f4755d7e3c tempest-GroupsTest-598714453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f3a6b06f-d7fb-4367-b502-b5028c5fd798" returned: 0 in 1.319s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e4d9d74d-4e39-454d-a346-a9f4755d7e3c tempest-GroupsTest-598714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f3a6b06f-d7fb-4367-b502-b5028c5fd798 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-4d9efb22-47d2-4b20-ab80-39db7031f6e2 req-7e67da06-1966-43b5-9b32-3347fecfe513 tempest-AttachVolumeNegativeTest-1857772135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:06:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-4d9efb22-47d2-4b20-ab80-39db7031f6e2 req-7e67da06-1966-43b5-9b32-3347fecfe513 tempest-AttachVolumeNegativeTest-1857772135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:06:58 devstack sudo[92055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f3a6b06f-d7fb-4367-b502-b5028c5fd798 Jul 03 01:06:58 devstack sudo[92055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:58 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b3ffb9-fbd8-4d49-900f-67f2403d8d22]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:06:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-4d9efb22-47d2-4b20-ab80-39db7031f6e2 req-7e67da06-1966-43b5-9b32-3347fecfe513 tempest-AttachVolumeNegativeTest-1857772135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:58 devstack sudo[92061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4 Jul 03 01:06:58 devstack sudo[92061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:59 devstack sudo[92053]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_pj7aw541" returned: 1 in 0.880s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_pj7aw541' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8e1e5c-4247-4542-85ec-253b2b1827cf]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_3wscu_kzdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:59 devstack sudo[92055]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e4d9d74d-4e39-454d-a346-a9f4755d7e3c tempest-GroupsTest-598714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f3a6b06f-d7fb-4367-b502-b5028c5fd798" returned: 0 in 0.706s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e4d9d74d-4e39-454d-a346-a9f4755d7e3c tempest-GroupsTest-598714453 None] Lock "cinder-quobyte-f3a6b06f-d7fb-4367-b502-b5028c5fd798" released by "delete_volume" :: held 2.091s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:06:59 devstack sudo[92066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_3wscu_kzdevstack@QuobyteHD Jul 03 01:06:59 devstack sudo[92066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e4d9d74d-4e39-454d-a346-a9f4755d7e3c tempest-GroupsTest-598714453 None] Created reservations ['f740a824-4ea8-4ecd-9c1b-f7305d2b1cd8'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:06:59 devstack cinder-volume[86772]: WARNING cinder.quota [None req-e4d9d74d-4e39-454d-a346-a9f4755d7e3c tempest-GroupsTest-598714453 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-449359131 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-449359131, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:06:59 devstack cinder-volume[86772]: WARNING cinder.quota [None req-e4d9d74d-4e39-454d-a346-a9f4755d7e3c tempest-GroupsTest-598714453 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-449359131 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-449359131, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e4d9d74d-4e39-454d-a346-a9f4755d7e3c tempest-GroupsTest-598714453 None] Created reservations ['88e8ef69-0837-4b38-be43-df8743004cba', '5e2650fd-b0a8-49b9-ab7e-3400d73bc683', 'dfdb0da0-fd8a-4983-a108-506737d440b2', 'b762e49a-29e4-49f1-a8f8-f8f9570308b4'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:06:59 devstack sudo[92061]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-4d9efb22-47d2-4b20-ab80-39db7031f6e2 req-7e67da06-1966-43b5-9b32-3347fecfe513 tempest-AttachVolumeNegativeTest-1857772135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4" returned: 0 in 0.922s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-4d9efb22-47d2-4b20-ab80-39db7031f6e2 req-7e67da06-1966-43b5-9b32-3347fecfe513 tempest-AttachVolumeNegativeTest-1857772135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.947s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e4d9d74d-4e39-454d-a346-a9f4755d7e3c tempest-GroupsTest-598714453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e4d9d74d-4e39-454d-a346-a9f4755d7e3c tempest-GroupsTest-598714453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e4d9d74d-4e39-454d-a346-a9f4755d7e3c tempest-GroupsTest-598714453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e4d9d74d-4e39-454d-a346-a9f4755d7e3c tempest-GroupsTest-598714453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e4d9d74d-4e39-454d-a346-a9f4755d7e3c tempest-GroupsTest-598714453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e4d9d74d-4e39-454d-a346-a9f4755d7e3c tempest-GroupsTest-598714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-4d9efb22-47d2-4b20-ab80-39db7031f6e2 req-7e67da06-1966-43b5-9b32-3347fecfe513 tempest-AttachVolumeNegativeTest-1857772135 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171', 'name': 'volume-b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'caf575bb-d3ab-4967-b32f-bed70edde3a1', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:06:59 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:06:59 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:59 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-4d9efb22-47d2-4b20-ab80-39db7031f6e2 req-7e67da06-1966-43b5-9b32-3347fecfe513 tempest-AttachVolumeNegativeTest-1857772135 None] attachment_update completed successfully. Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-84e20d08-54a5-4e25-8d00-2af64490f189 tempest-GroupsTest-598714453 None] Created reservations ['4a5b140b-661b-40e3-a776-9b8aa269810d'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-84e20d08-54a5-4e25-8d00-2af64490f189 tempest-GroupsTest-598714453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-84e20d08-54a5-4e25-8d00-2af64490f189 tempest-GroupsTest-598714453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-84e20d08-54a5-4e25-8d00-2af64490f189 tempest-GroupsTest-598714453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-84e20d08-54a5-4e25-8d00-2af64490f189 tempest-GroupsTest-598714453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-84e20d08-54a5-4e25-8d00-2af64490f189 tempest-GroupsTest-598714453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-84e20d08-54a5-4e25-8d00-2af64490f189 tempest-GroupsTest-598714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:06:59 devstack sudo[92076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:06:59 devstack sudo[92076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:06:59 devstack sudo[92066]: pam_unix(sudo:session): session closed for user root Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_3wscu_kzdevstack@QuobyteHD" returned: 0 in 0.853s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] 3d536ca8-2cba-4b44-93ed-ed247e842444 was qcow2, converting to raw {{(pid=86772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 01:06:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_3wscu_kzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:00 devstack sudo[92078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_3wscu_kzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc Jul 03 01:07:00 devstack sudo[92078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:00 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e4d9d74d-4e39-454d-a346-a9f4755d7e3c tempest-GroupsTest-598714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.861s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:00 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-e4d9d74d-4e39-454d-a346-a9f4755d7e3c tempest-GroupsTest-598714453 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:07:00 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e4d9d74d-4e39-454d-a346-a9f4755d7e3c tempest-GroupsTest-598714453 None] Delete group completed successfully. Jul 03 01:07:00 devstack sudo[92076]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-84e20d08-54a5-4e25-8d00-2af64490f189 tempest-GroupsTest-598714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.768s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:00 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-84e20d08-54a5-4e25-8d00-2af64490f189 tempest-GroupsTest-598714453 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:07:00 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-84e20d08-54a5-4e25-8d00-2af64490f189 tempest-GroupsTest-598714453 None] Delete group completed successfully. Jul 03 01:07:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-55536e51-252d-42ae-be73-f2131e8fa673 tempest-GroupsTest-598714453 None] Group tempest-GroupsTest-Group-1474678800: creating Jul 03 01:07:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-55536e51-252d-42ae-be73-f2131e8fa673 tempest-GroupsTest-598714453 None] Group tempest-GroupsTest-Group-1474678800: created successfully Jul 03 01:07:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-55536e51-252d-42ae-be73-f2131e8fa673 tempest-GroupsTest-598714453 None] Create group completed successfully. Jul 03 01:07:02 devstack sudo[92078]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_3wscu_kzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc" returned: 0 in 2.300s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:02 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_3wscu_kzdevstack@QuobyteHD, size 112.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:07:02 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Converted 112.00 MB image at 48.69 MB/s Jul 03 01:07:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:02 devstack sudo[92473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc 1G Jul 03 01:07:02 devstack sudo[92473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:02 devstack sudo[92473]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc 1G" returned: 0 in 0.693s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:03 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadbdc40-54f5-4f1f-8fd9-909f7a4d31ea]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:07:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:03 devstack sudo[92478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc Jul 03 01:07:03 devstack sudo[92478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:03 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:07:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Flow 'volume_create_manager' (67514ed0-0d21-4ade-90cb-5c6c94d982ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:07:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0221c93-c6f0-4729-96b1-8abec604640c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0221c93-c6f0-4729-96b1-8abec604640c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1175572085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=74764ee5-740b-49ec-9068-bf5a398c49f8,host='devstack@QuobyteHD#QuobyteHD',id=774dd423-8eaf-4ebd-aa3a-519833ebea94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2136ea67be5b416683f3a84011dab1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:03Z,use_quota=True,user_id='e01bafeb3ecd408eab475ceb207438cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(147cd2de-c1a6-489c-ae16-0df88dd31050),volume_type_id=147cd2de-c1a6-489c-ae16-0df88dd31050)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4064f92b-5b86-481a-9881-a50039cb15e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4064f92b-5b86-481a-9881-a50039cb15e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a92610-bb8e-411b-877b-d7f6d723e9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a92610-bb8e-411b-877b-d7f6d723e9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '774dd423-8eaf-4ebd-aa3a-519833ebea94', 'volume_name': 'volume-774dd423-8eaf-4ebd-aa3a-519833ebea94', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3daa28-810d-4b83-b97f-910a97aea070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3daa28-810d-4b83-b97f-910a97aea070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62842287-be40-4b49-a49d-3273c84585aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:03 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Volume 774dd423-8eaf-4ebd-aa3a-519833ebea94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-774dd423-8eaf-4ebd-aa3a-519833ebea94', 'volume_size': 1} Jul 03 01:07:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=74764ee5-740b-49ec-9068-bf5a398c49f8,created_at=2026-07-02T23:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1175572085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=74764ee5-740b-49ec-9068-bf5a398c49f8,host='devstack@QuobyteHD#QuobyteHD',id=774dd423-8eaf-4ebd-aa3a-519833ebea94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2136ea67be5b416683f3a84011dab1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:03Z,use_quota=True,user_id='e01bafeb3ecd408eab475ceb207438cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(147cd2de-c1a6-489c-ae16-0df88dd31050),volume_type_id=147cd2de-c1a6-489c-ae16-0df88dd31050)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:07:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Creating volume 774dd423-8eaf-4ebd-aa3a-519833ebea94 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:07:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:07:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:07:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:07:03 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:07:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-774dd423-8eaf-4ebd-aa3a-519833ebea94 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:03 devstack sudo[92514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-774dd423-8eaf-4ebd-aa3a-519833ebea94 1073741824 Jul 03 01:07:03 devstack sudo[92514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:03 devstack sudo[92478]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc" returned: 0 in 0.909s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:04 devstack sudo[92520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc Jul 03 01:07:04 devstack sudo[92520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:04 devstack sudo[92514]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-774dd423-8eaf-4ebd-aa3a-519833ebea94 1073741824" returned: 0 in 1.149s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-774dd423-8eaf-4ebd-aa3a-519833ebea94 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:04 devstack sudo[92526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-774dd423-8eaf-4ebd-aa3a-519833ebea94 Jul 03 01:07:04 devstack sudo[92526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:04 devstack sudo[92520]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc" returned: 1 in 1.051s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:07:04 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Downloaded image 3d536ca8-2cba-4b44-93ed-ed247e842444 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d536ca8-2cba-4b44-93ed-ed247e842444', 'metadata': {}}])) to volume c741c82b-ad1d-4235-a559-52c749dcfcdc successfully. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 01:07:04 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Temporary image 3d536ca8-2cba-4b44-93ed-ed247e842444 for user 7fd1fff33dba4a6fb921ba6bcbd1de78 is deleted. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 01:07:04 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Marking volume c741c82b-ad1d-4235-a559-52c749dcfcdc as bootable. {{(pid=86772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 01:07:05 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Copying metadata from image 3d536ca8-2cba-4b44-93ed-ed247e842444 to c741c82b-ad1d-4235-a559-52c749dcfcdc. {{(pid=86772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 01:07:05 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Creating volume glance metadata for volume c741c82b-ad1d-4235-a559-52c749dcfcdc backed by image 3d536ca8-2cba-4b44-93ed-ed247e842444 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 01:07:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5a55b4-434f-4f51-801e-b8033d1a98dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c741c82b-ad1d-4235-a559-52c749dcfcdc', 'volume_size': 1, 'image_id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d536ca8-2cba-4b44-93ed-ed247e842444', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b88b4a33269476b9f6e11e7fe82fb87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'created_at': datetime.datetime(2026, 7, 2, 22, 56, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 56, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d536ca8-2cba-4b44-93ed-ed247e842444/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e7600b-530d-4f40-957c-898d7db6b8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:05 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Volume volume-c741c82b-ad1d-4235-a559-52c749dcfcdc (c741c82b-ad1d-4235-a559-52c749dcfcdc): created successfully Jul 03 01:07:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e7600b-530d-4f40-957c-898d7db6b8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Flow 'volume_create_manager' (1d09ecda-6912-41bc-bfac-66b2a413a492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:07:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-46cb74bc-1394-4cd2-bc52-da045e7cd698 tempest-VolumesImageMetadata-1798699999 None] Created volume successfully. Jul 03 01:07:05 devstack sudo[92526]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-774dd423-8eaf-4ebd-aa3a-519833ebea94" returned: 0 in 0.782s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] <== create_volume: return (1998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:07:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62842287-be40-4b49-a49d-3273c84585aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-774dd423-8eaf-4ebd-aa3a-519833ebea94', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b76b2edc-ca3b-4ae8-981a-8be0ce7d62e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:05 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Volume volume-774dd423-8eaf-4ebd-aa3a-519833ebea94 (774dd423-8eaf-4ebd-aa3a-519833ebea94): created successfully Jul 03 01:07:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b76b2edc-ca3b-4ae8-981a-8be0ce7d62e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Flow 'volume_create_manager' (67514ed0-0d21-4ade-90cb-5c6c94d982ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:07:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8e559102-3103-4448-8423-51319db970bc tempest-GroupsTest-598714453 None] Created volume successfully. Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-329d926e-c189-441d-9d18-25bad75e8655 tempest-VolumesImageMetadata-1798699999 None] Acquiring lock "cinder-c741c82b-ad1d-4235-a559-52c749dcfcdc-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-329d926e-c189-441d-9d18-25bad75e8655 tempest-VolumesImageMetadata-1798699999 None] Lock "cinder-c741c82b-ad1d-4235-a559-52c749dcfcdc-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-329d926e-c189-441d-9d18-25bad75e8655 tempest-VolumesImageMetadata-1798699999 None] Acquiring lock "cinder-quobyte-c741c82b-ad1d-4235-a559-52c749dcfcdc" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-329d926e-c189-441d-9d18-25bad75e8655 tempest-VolumesImageMetadata-1798699999 None] Lock "cinder-quobyte-c741c82b-ad1d-4235-a559-52c749dcfcdc" acquired by "delete_volume" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b60324-b2ed-4fc3-8438-598021ef32ba]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-329d926e-c189-441d-9d18-25bad75e8655 tempest-VolumesImageMetadata-1798699999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Flow 'volume_create_manager' (7a162066-0969-4f78-a3f0-d45ed0e33b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91e0eca-ded6-48b2-9964-bf9bf4d4e3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:06 devstack sudo[92533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc Jul 03 01:07:06 devstack sudo[92533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91e0eca-ded6-48b2-9964-bf9bf4d4e3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-877351451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=74764ee5-740b-49ec-9068-bf5a398c49f8,host='devstack@QuobyteHD#QuobyteHD',id=f5b7d074-1069-4048-9a6a-14783e41302e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2136ea67be5b416683f3a84011dab1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:07Z,use_quota=True,user_id='e01bafeb3ecd408eab475ceb207438cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(147cd2de-c1a6-489c-ae16-0df88dd31050),volume_type_id=147cd2de-c1a6-489c-ae16-0df88dd31050)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b53d6c4-4f04-4c0d-9ce7-112d23584fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b53d6c4-4f04-4c0d-9ce7-112d23584fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdaafdc5-6ea4-4dc0-a435-1f14277734cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdaafdc5-6ea4-4dc0-a435-1f14277734cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5b7d074-1069-4048-9a6a-14783e41302e', 'volume_name': 'volume-f5b7d074-1069-4048-9a6a-14783e41302e', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8178aaee-58b0-461a-9348-77a3ac36ac93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8178aaee-58b0-461a-9348-77a3ac36ac93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9327f7da-054e-4f1b-a8fa-efdd2bcb535e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:06 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Volume f5b7d074-1069-4048-9a6a-14783e41302e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5b7d074-1069-4048-9a6a-14783e41302e', 'volume_size': 1} Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=74764ee5-740b-49ec-9068-bf5a398c49f8,created_at=2026-07-02T23:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-877351451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=74764ee5-740b-49ec-9068-bf5a398c49f8,host='devstack@QuobyteHD#QuobyteHD',id=f5b7d074-1069-4048-9a6a-14783e41302e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2136ea67be5b416683f3a84011dab1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:07Z,use_quota=True,user_id='e01bafeb3ecd408eab475ceb207438cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(147cd2de-c1a6-489c-ae16-0df88dd31050),volume_type_id=147cd2de-c1a6-489c-ae16-0df88dd31050)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Creating volume f5b7d074-1069-4048-9a6a-14783e41302e {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:07:06 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:07:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f5b7d074-1069-4048-9a6a-14783e41302e 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:06 devstack sudo[92536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f5b7d074-1069-4048-9a6a-14783e41302e 1073741824 Jul 03 01:07:06 devstack sudo[92536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:07 devstack sudo[92533]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-329d926e-c189-441d-9d18-25bad75e8655 tempest-VolumesImageMetadata-1798699999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc" returned: 0 in 1.034s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-329d926e-c189-441d-9d18-25bad75e8655 tempest-VolumesImageMetadata-1798699999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:07 devstack sudo[92543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc Jul 03 01:07:07 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:08 devstack sudo[92536]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f5b7d074-1069-4048-9a6a-14783e41302e 1073741824" returned: 0 in 1.136s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f5b7d074-1069-4048-9a6a-14783e41302e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:08 devstack sudo[92548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f5b7d074-1069-4048-9a6a-14783e41302e Jul 03 01:07:08 devstack sudo[92548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:08 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-329d926e-c189-441d-9d18-25bad75e8655 tempest-VolumesImageMetadata-1798699999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc" returned: 1 in 1.250s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-329d926e-c189-441d-9d18-25bad75e8655 tempest-VolumesImageMetadata-1798699999 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:07:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-329d926e-c189-441d-9d18-25bad75e8655 tempest-VolumesImageMetadata-1798699999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:08 devstack sudo[92548]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f5b7d074-1069-4048-9a6a-14783e41302e" returned: 0 in 0.865s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:07:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:09 devstack sudo[92555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc Jul 03 01:07:09 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9327f7da-054e-4f1b-a8fa-efdd2bcb535e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5b7d074-1069-4048-9a6a-14783e41302e', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e30d1219-8904-455d-816d-8f808cb287a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:09 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Volume volume-f5b7d074-1069-4048-9a6a-14783e41302e (f5b7d074-1069-4048-9a6a-14783e41302e): created successfully Jul 03 01:07:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e30d1219-8904-455d-816d-8f808cb287a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Flow 'volume_create_manager' (7a162066-0969-4f78-a3f0-d45ed0e33b2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:07:09 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8b01bee5-251f-4d71-97d2-ca648c9195ae tempest-GroupsTest-598714453 None] Created volume successfully. Jul 03 01:07:09 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-329d926e-c189-441d-9d18-25bad75e8655 tempest-VolumesImageMetadata-1798699999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c741c82b-ad1d-4235-a559-52c749dcfcdc" returned: 0 in 0.758s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-329d926e-c189-441d-9d18-25bad75e8655 tempest-VolumesImageMetadata-1798699999 None] Lock "cinder-quobyte-c741c82b-ad1d-4235-a559-52c749dcfcdc" released by "delete_volume" :: held 3.126s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:07:09 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-329d926e-c189-441d-9d18-25bad75e8655 tempest-VolumesImageMetadata-1798699999 None] Created reservations ['e62aafbf-a75c-40b3-a29f-8e647f5c7cd6', '2a7a205b-7072-439c-9e95-0b41e2377963', '5aa5773b-b9f3-4e6d-9a6a-c310a37e609e', 'b0a8e6c8-835f-4763-9cbd-bfb3ef57ccf3'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:07:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-329d926e-c189-441d-9d18-25bad75e8655 tempest-VolumesImageMetadata-1798699999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-329d926e-c189-441d-9d18-25bad75e8655 tempest-VolumesImageMetadata-1798699999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-329d926e-c189-441d-9d18-25bad75e8655 tempest-VolumesImageMetadata-1798699999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:07:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-329d926e-c189-441d-9d18-25bad75e8655 tempest-VolumesImageMetadata-1798699999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:07:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-329d926e-c189-441d-9d18-25bad75e8655 tempest-VolumesImageMetadata-1798699999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-329d926e-c189-441d-9d18-25bad75e8655 tempest-VolumesImageMetadata-1798699999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:09 devstack sudo[92559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:07:09 devstack sudo[92559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:10 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9587bb7c-58a9-4984-9f92-10e9f69ab298 tempest-GroupsTest-598714453 None] Update group completed successfully. Jul 03 01:07:10 devstack sudo[92559]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-329d926e-c189-441d-9d18-25bad75e8655 tempest-VolumesImageMetadata-1798699999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.853s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:10 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-329d926e-c189-441d-9d18-25bad75e8655 tempest-VolumesImageMetadata-1798699999 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:07:10 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-329d926e-c189-441d-9d18-25bad75e8655 tempest-VolumesImageMetadata-1798699999 None] Deleted volume successfully. Jul 03 01:07:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-329d926e-c189-441d-9d18-25bad75e8655 tempest-VolumesImageMetadata-1798699999 None] Lock "cinder-c741c82b-ad1d-4235-a559-52c749dcfcdc-delete_volume" released by "delete_volume" :: held 4.286s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:07:12 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3f1ac384-24cc-4058-9768-db5c62492dda tempest-GroupsTest-598714453 None] Update group completed successfully. Jul 03 01:07:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:07:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:07:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:07:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:12 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:07:12 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:14 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.340s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] Acquiring lock "cinder-quobyte-774dd423-8eaf-4ebd-aa3a-519833ebea94" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] Lock "cinder-quobyte-774dd423-8eaf-4ebd-aa3a-519833ebea94" acquired by "delete_volume" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6649dd2-c626-4fb8-b949-7624d0033284]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-774dd423-8eaf-4ebd-aa3a-519833ebea94 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:07:14 devstack sudo[92569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-774dd423-8eaf-4ebd-aa3a-519833ebea94 Jul 03 01:07:14 devstack sudo[92569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Flow 'volume_create_manager' (ff145bfc-caf2-4d9c-aff2-efc01fc713cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8125a4f-855a-4f31-b128-87e74dc70a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8125a4f-855a-4f31-b128-87e74dc70a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-332191911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b89984de-2b60-4be9-9999-eee4c55503a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0454491e53642cb864c00a59337948c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:14Z,use_quota=True,user_id='7335cbaf277d40c6ab81f5178a9a088d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b6afa89-1222-44a9-919d-cea1b6946729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b6afa89-1222-44a9-919d-cea1b6946729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a374842b-86f8-4033-814a-7bb3da2e2bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a374842b-86f8-4033-814a-7bb3da2e2bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b89984de-2b60-4be9-9999-eee4c55503a5', 'volume_name': 'volume-b89984de-2b60-4be9-9999-eee4c55503a5', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdad0fe-c861-46ed-a6d8-0d5b96c3e88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdad0fe-c861-46ed-a6d8-0d5b96c3e88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (301b9cb3-2157-4546-9c0e-7e03fa90c91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:14 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Volume b89984de-2b60-4be9-9999-eee4c55503a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b89984de-2b60-4be9-9999-eee4c55503a5', 'volume_size': 1} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-332191911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b89984de-2b60-4be9-9999-eee4c55503a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0454491e53642cb864c00a59337948c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:14Z,use_quota=True,user_id='7335cbaf277d40c6ab81f5178a9a088d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Creating volume b89984de-2b60-4be9-9999-eee4c55503a5 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:07:14 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:07:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b89984de-2b60-4be9-9999-eee4c55503a5 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:14 devstack sudo[92571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b89984de-2b60-4be9-9999-eee4c55503a5 1073741824 Jul 03 01:07:14 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:15 devstack sudo[92569]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-774dd423-8eaf-4ebd-aa3a-519833ebea94" returned: 0 in 1.221s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-774dd423-8eaf-4ebd-aa3a-519833ebea94 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:15 devstack sudo[92596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-774dd423-8eaf-4ebd-aa3a-519833ebea94 Jul 03 01:07:15 devstack sudo[92596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:15 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b89984de-2b60-4be9-9999-eee4c55503a5 1073741824" returned: 0 in 1.186s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b89984de-2b60-4be9-9999-eee4c55503a5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:15 devstack sudo[92599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b89984de-2b60-4be9-9999-eee4c55503a5 Jul 03 01:07:15 devstack sudo[92599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:16 devstack sudo[92596]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-774dd423-8eaf-4ebd-aa3a-519833ebea94" returned: 0 in 0.848s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] Lock "cinder-quobyte-774dd423-8eaf-4ebd-aa3a-519833ebea94" released by "delete_volume" :: held 2.169s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:07:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] Acquiring lock "cinder-quobyte-f5b7d074-1069-4048-9a6a-14783e41302e" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:07:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] Lock "cinder-quobyte-f5b7d074-1069-4048-9a6a-14783e41302e" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:07:16 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6362e9-49c4-4e43-89bb-963b54834e51]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:07:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f5b7d074-1069-4048-9a6a-14783e41302e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:16 devstack sudo[92603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f5b7d074-1069-4048-9a6a-14783e41302e Jul 03 01:07:16 devstack sudo[92603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:16 devstack sudo[92599]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b89984de-2b60-4be9-9999-eee4c55503a5" returned: 0 in 0.846s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] <== create_volume: return (2097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:07:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.103s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (301b9cb3-2157-4546-9c0e-7e03fa90c91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b89984de-2b60-4be9-9999-eee4c55503a5', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ddffb52-092c-4247-b241-22e65de60c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:16 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Volume volume-b89984de-2b60-4be9-9999-eee4c55503a5 (b89984de-2b60-4be9-9999-eee4c55503a5): created successfully Jul 03 01:07:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ddffb52-092c-4247-b241-22e65de60c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Flow 'volume_create_manager' (ff145bfc-caf2-4d9c-aff2-efc01fc713cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:07:16 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4fa702f7-cbf0-43e5-a854-2886a7545043 tempest-VolumesMetadataTest-1352031828 None] Created volume successfully. Jul 03 01:07:17 devstack sudo[92603]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f5b7d074-1069-4048-9a6a-14783e41302e" returned: 0 in 0.856s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f5b7d074-1069-4048-9a6a-14783e41302e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:17 devstack sudo[92609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f5b7d074-1069-4048-9a6a-14783e41302e Jul 03 01:07:17 devstack sudo[92609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:18 devstack sudo[92609]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f5b7d074-1069-4048-9a6a-14783e41302e" returned: 0 in 0.859s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] Lock "cinder-quobyte-f5b7d074-1069-4048-9a6a-14783e41302e" released by "delete_volume" :: held 1.770s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:07:18 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] Created reservations ['25b1b301-0691-40cd-b006-905a17e787c7'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:07:18 devstack cinder-volume[86772]: WARNING cinder.quota [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1687654353 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1687654353, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:07:18 devstack cinder-volume[86772]: WARNING cinder.quota [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1687654353 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1687654353, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:07:18 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] Created reservations ['d204621f-8f31-4dca-80bb-cc4f5ce937a6', '3ce5ac3d-671f-464e-bcb7-79dd5634689b', '805cef9a-7ab0-42fe-ae52-41a20ff32d07', 'c514d453-1cbb-491e-802b-cfac3c88af0b'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:07:18 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] Created reservations ['a50e53ef-6b33-4387-82ec-843434e957f2', 'fc9d90db-ca39-4e63-90ac-266cc6a63e6b', 'c2cf6efd-1529-41e8-a9c4-98e6085d867a', '4dd177ff-39cb-433b-a046-f29169c240e5'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:07:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a7922c04-eceb-4d76-99d1-edda8ca1a285 tempest-VolumesMetadataTest-1352031828 None] Acquiring lock "cinder-b89984de-2b60-4be9-9999-eee4c55503a5-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:07:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a7922c04-eceb-4d76-99d1-edda8ca1a285 tempest-VolumesMetadataTest-1352031828 None] Lock "cinder-b89984de-2b60-4be9-9999-eee4c55503a5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:07:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a7922c04-eceb-4d76-99d1-edda8ca1a285 tempest-VolumesMetadataTest-1352031828 None] Acquiring lock "cinder-quobyte-b89984de-2b60-4be9-9999-eee4c55503a5" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:07:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a7922c04-eceb-4d76-99d1-edda8ca1a285 tempest-VolumesMetadataTest-1352031828 None] Lock "cinder-quobyte-b89984de-2b60-4be9-9999-eee4c55503a5" acquired by "delete_volume" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:07:18 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9073bd-cabb-47fe-acf0-001a489e3f12]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:07:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a7922c04-eceb-4d76-99d1-edda8ca1a285 tempest-VolumesMetadataTest-1352031828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b89984de-2b60-4be9-9999-eee4c55503a5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:07:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:07:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:18 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:07:18 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:18 devstack sudo[92613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b89984de-2b60-4be9-9999-eee4c55503a5 Jul 03 01:07:18 devstack sudo[92613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:19 devstack sudo[92613]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a7922c04-eceb-4d76-99d1-edda8ca1a285 tempest-VolumesMetadataTest-1352031828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b89984de-2b60-4be9-9999-eee4c55503a5" returned: 0 in 1.174s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a7922c04-eceb-4d76-99d1-edda8ca1a285 tempest-VolumesMetadataTest-1352031828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b89984de-2b60-4be9-9999-eee4c55503a5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:19 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.130s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:19 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:07:19 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-dfacef4a-d745-448f-a539-3634fae65cfc tempest-GroupsTest-598714453 None] Delete group completed successfully. Jul 03 01:07:19 devstack sudo[92624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b89984de-2b60-4be9-9999-eee4c55503a5 Jul 03 01:07:19 devstack sudo[92624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:20 devstack sudo[92624]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a7922c04-eceb-4d76-99d1-edda8ca1a285 tempest-VolumesMetadataTest-1352031828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b89984de-2b60-4be9-9999-eee4c55503a5" returned: 0 in 0.819s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a7922c04-eceb-4d76-99d1-edda8ca1a285 tempest-VolumesMetadataTest-1352031828 None] Lock "cinder-quobyte-b89984de-2b60-4be9-9999-eee4c55503a5" released by "delete_volume" :: held 2.052s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:07:20 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-a7922c04-eceb-4d76-99d1-edda8ca1a285 tempest-VolumesMetadataTest-1352031828 None] Created reservations ['767f259d-b60f-45d7-89d3-f1716fa31656', 'c27a2bc8-563d-4210-97bf-417b41d7c7de', 'f678791c-d113-4108-95ee-d558a6b8081d', 'baf377fe-681d-4c27-aa4c-a10801ac34ae'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:07:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a7922c04-eceb-4d76-99d1-edda8ca1a285 tempest-VolumesMetadataTest-1352031828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a7922c04-eceb-4d76-99d1-edda8ca1a285 tempest-VolumesMetadataTest-1352031828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a7922c04-eceb-4d76-99d1-edda8ca1a285 tempest-VolumesMetadataTest-1352031828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:07:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a7922c04-eceb-4d76-99d1-edda8ca1a285 tempest-VolumesMetadataTest-1352031828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:07:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a7922c04-eceb-4d76-99d1-edda8ca1a285 tempest-VolumesMetadataTest-1352031828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a7922c04-eceb-4d76-99d1-edda8ca1a285 tempest-VolumesMetadataTest-1352031828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:20 devstack sudo[92652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:07:20 devstack sudo[92652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:22 devstack sudo[92652]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a7922c04-eceb-4d76-99d1-edda8ca1a285 tempest-VolumesMetadataTest-1352031828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.317s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:22 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-a7922c04-eceb-4d76-99d1-edda8ca1a285 tempest-VolumesMetadataTest-1352031828 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:07:22 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a7922c04-eceb-4d76-99d1-edda8ca1a285 tempest-VolumesMetadataTest-1352031828 None] Deleted volume successfully. Jul 03 01:07:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a7922c04-eceb-4d76-99d1-edda8ca1a285 tempest-VolumesMetadataTest-1352031828 None] Lock "cinder-b89984de-2b60-4be9-9999-eee4c55503a5-delete_volume" released by "delete_volume" :: held 3.685s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:07:30 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:07:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Flow 'volume_create_manager' (f3dc5245-34be-47e5-916b-71fbb8b0bcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:07:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c688e7-2d3b-47e4-ab41-5065a9ec888d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c688e7-2d3b-47e4-ab41-5065a9ec888d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1696005970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c0fed02-a6d1-4b7e-b902-f1dd664f9f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df66b14ce0d6491d9f6dbc6055fe9ee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:31Z,use_quota=True,user_id='81657dfa878c46cab5b69177a43caad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58fbd451-8566-4461-b0f2-661031efcbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58fbd451-8566-4461-b0f2-661031efcbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33bd6088-44a2-4c7d-8c2d-ab6cfb6ee51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33bd6088-44a2-4c7d-8c2d-ab6cfb6ee51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c0fed02-a6d1-4b7e-b902-f1dd664f9f71', 'volume_name': 'volume-5c0fed02-a6d1-4b7e-b902-f1dd664f9f71', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547ceed1-96bc-402b-b66d-6747c10026f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547ceed1-96bc-402b-b66d-6747c10026f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc4970a5-2195-4335-926f-219671006fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:30 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Volume 5c0fed02-a6d1-4b7e-b902-f1dd664f9f71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c0fed02-a6d1-4b7e-b902-f1dd664f9f71', 'volume_size': 1} Jul 03 01:07:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1696005970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c0fed02-a6d1-4b7e-b902-f1dd664f9f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df66b14ce0d6491d9f6dbc6055fe9ee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:31Z,use_quota=True,user_id='81657dfa878c46cab5b69177a43caad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:07:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Creating volume 5c0fed02-a6d1-4b7e-b902-f1dd664f9f71 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:07:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:07:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:07:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:07:30 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:07:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5c0fed02-a6d1-4b7e-b902-f1dd664f9f71 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:30 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3aff03c5-f3a5-4eca-b3cf-907f8b55db66 tempest-GroupsV314Test-1380891647 None] Group tempest-GroupsV314Test-Group-832752113: creating Jul 03 01:07:30 devstack sudo[92714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5c0fed02-a6d1-4b7e-b902-f1dd664f9f71 1073741824 Jul 03 01:07:30 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:30 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3aff03c5-f3a5-4eca-b3cf-907f8b55db66 tempest-GroupsV314Test-1380891647 None] Group tempest-GroupsV314Test-Group-832752113: created successfully Jul 03 01:07:30 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3aff03c5-f3a5-4eca-b3cf-907f8b55db66 tempest-GroupsV314Test-1380891647 None] Create group completed successfully. Jul 03 01:07:31 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5c0fed02-a6d1-4b7e-b902-f1dd664f9f71 1073741824" returned: 0 in 1.066s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5c0fed02-a6d1-4b7e-b902-f1dd664f9f71 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:31 devstack sudo[92721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5c0fed02-a6d1-4b7e-b902-f1dd664f9f71 Jul 03 01:07:31 devstack sudo[92721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:32 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:07:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Flow 'volume_create_manager' (a2f48802-9bbe-4280-a64d-00965d3caea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:07:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9decbad-731d-49d0-b5ee-6221d1405578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9decbad-731d-49d0-b5ee-6221d1405578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-998320269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5f00cfb9-21c7-4584-9479-5e99f71518db,host='devstack@QuobyteHD#QuobyteHD',id=2d95dd82-3365-4dff-bef4-0ad274ebec76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dcb3da63a16475aa31ceb96479d50c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:33Z,use_quota=True,user_id='1599e2b51d8243dca07148ea838c36f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c961bb30-0fc1-4e38-97a8-fee0541f5cc7),volume_type_id=c961bb30-0fc1-4e38-97a8-fee0541f5cc7)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ff63b2-763f-4b41-9e44-ab5b17f2586f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ff63b2-763f-4b41-9e44-ab5b17f2586f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8762178-2813-43d9-8a96-c8d0b88239ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8762178-2813-43d9-8a96-c8d0b88239ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d95dd82-3365-4dff-bef4-0ad274ebec76', 'volume_name': 'volume-2d95dd82-3365-4dff-bef4-0ad274ebec76', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b028bf-711e-4351-b19c-af675864aa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b028bf-711e-4351-b19c-af675864aa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a817ed-5784-40e6-86cb-7cd2b8b33c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:32 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Volume 2d95dd82-3365-4dff-bef4-0ad274ebec76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d95dd82-3365-4dff-bef4-0ad274ebec76', 'volume_size': 1} Jul 03 01:07:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:33 devstack sudo[92721]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5c0fed02-a6d1-4b7e-b902-f1dd664f9f71" returned: 0 in 1.079s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] <== create_volume: return (2210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:07:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.212s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.240s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5f00cfb9-21c7-4584-9479-5e99f71518db,created_at=2026-07-02T23:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-998320269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5f00cfb9-21c7-4584-9479-5e99f71518db,host='devstack@QuobyteHD#QuobyteHD',id=2d95dd82-3365-4dff-bef4-0ad274ebec76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dcb3da63a16475aa31ceb96479d50c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:33Z,use_quota=True,user_id='1599e2b51d8243dca07148ea838c36f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c961bb30-0fc1-4e38-97a8-fee0541f5cc7),volume_type_id=c961bb30-0fc1-4e38-97a8-fee0541f5cc7)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:07:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Creating volume 2d95dd82-3365-4dff-bef4-0ad274ebec76 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:07:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:07:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:07:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:07:33 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:07:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:33 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=90,cinder:UPDATE=86,cinder:INSERT=21,cinder:DELETE=3 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:07:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc4970a5-2195-4335-926f-219671006fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c0fed02-a6d1-4b7e-b902-f1dd664f9f71', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:33 devstack sudo[92724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76 1073741824 Jul 03 01:07:33 devstack sudo[92724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e48272e-0cb6-49a2-8f1c-43386950d97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:33 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Volume volume-5c0fed02-a6d1-4b7e-b902-f1dd664f9f71 (5c0fed02-a6d1-4b7e-b902-f1dd664f9f71): created successfully Jul 03 01:07:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e48272e-0cb6-49a2-8f1c-43386950d97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Flow 'volume_create_manager' (f3dc5245-34be-47e5-916b-71fbb8b0bcbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:07:33 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-0cffeb45-1244-47aa-a6d4-24b2a2ca2b7a tempest-VolumesTransfersV357Test-7886453 None] Created volume successfully. Jul 03 01:07:34 devstack sudo[92724]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76 1073741824" returned: 0 in 1.103s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:34 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=72,cinder:UPDATE=86,cinder:INSERT=26,cinder:DELETE=7 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:07:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:34 devstack sudo[92730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76 Jul 03 01:07:34 devstack sudo[92730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:35 devstack sudo[92730]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76" returned: 0 in 0.998s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] <== create_volume: return (2178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:07:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.182s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:35 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e45f31fe-e028-4b67-a956-d41f244fa490 tempest-VolumesTransfersV357Test-1601592305 None] Transfer volume completed successfully. Jul 03 01:07:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a817ed-5784-40e6-86cb-7cd2b8b33c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d95dd82-3365-4dff-bef4-0ad274ebec76', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42da9175-f06f-4e5a-9c98-9a96a383704a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:35 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Volume volume-2d95dd82-3365-4dff-bef4-0ad274ebec76 (2d95dd82-3365-4dff-bef4-0ad274ebec76): created successfully Jul 03 01:07:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42da9175-f06f-4e5a-9c98-9a96a383704a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Flow 'volume_create_manager' (a2f48802-9bbe-4280-a64d-00965d3caea3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:07:35 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4a036fe6-3fca-4437-a9d9-9aa931e1b13e tempest-GroupsV314Test-1380891647 None] Created volume successfully. Jul 03 01:07:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d9b256e0-5aad-4535-8ce5-d7c044319d80 tempest-VolumesTransfersV357Test-108960796 None] Acquiring lock "cinder-5c0fed02-a6d1-4b7e-b902-f1dd664f9f71-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:07:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d9b256e0-5aad-4535-8ce5-d7c044319d80 tempest-VolumesTransfersV357Test-108960796 None] Lock "cinder-5c0fed02-a6d1-4b7e-b902-f1dd664f9f71-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:07:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d9b256e0-5aad-4535-8ce5-d7c044319d80 tempest-VolumesTransfersV357Test-108960796 None] Acquiring lock "cinder-quobyte-5c0fed02-a6d1-4b7e-b902-f1dd664f9f71" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:07:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d9b256e0-5aad-4535-8ce5-d7c044319d80 tempest-VolumesTransfersV357Test-108960796 None] Lock "cinder-quobyte-5c0fed02-a6d1-4b7e-b902-f1dd664f9f71" acquired by "delete_volume" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:07:36 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c8454b-87fd-4b8f-af78-8cd9f0d95a44]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:07:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d9b256e0-5aad-4535-8ce5-d7c044319d80 tempest-VolumesTransfersV357Test-108960796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5c0fed02-a6d1-4b7e-b902-f1dd664f9f71 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:36 devstack sudo[92757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5c0fed02-a6d1-4b7e-b902-f1dd664f9f71 Jul 03 01:07:36 devstack sudo[92757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:37 devstack sudo[92757]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d9b256e0-5aad-4535-8ce5-d7c044319d80 tempest-VolumesTransfersV357Test-108960796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5c0fed02-a6d1-4b7e-b902-f1dd664f9f71" returned: 0 in 0.805s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d9b256e0-5aad-4535-8ce5-d7c044319d80 tempest-VolumesTransfersV357Test-108960796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5c0fed02-a6d1-4b7e-b902-f1dd664f9f71 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:37 devstack sudo[92762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5c0fed02-a6d1-4b7e-b902-f1dd664f9f71 Jul 03 01:07:37 devstack sudo[92762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:37 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Cloning volume 2d95dd82-3365-4dff-bef4-0ad274ebec76 to volume ad16ae67-1115-4599-ad2b-d16b5ed242d2 Jul 03 01:07:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Creating offline snapshot 9a67f9b2-e704-4801-bdb0-318292a4114f of volume 2d95dd82-3365-4dff-bef4-0ad274ebec76 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:07:37 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b79335-177c-424d-916c-7a0868f3fc1c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:07:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:37 devstack sudo[92764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76 Jul 03 01:07:37 devstack sudo[92764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:37 devstack sudo[92762]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d9b256e0-5aad-4535-8ce5-d7c044319d80 tempest-VolumesTransfersV357Test-108960796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5c0fed02-a6d1-4b7e-b902-f1dd664f9f71" returned: 0 in 0.707s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d9b256e0-5aad-4535-8ce5-d7c044319d80 tempest-VolumesTransfersV357Test-108960796 None] Lock "cinder-quobyte-5c0fed02-a6d1-4b7e-b902-f1dd664f9f71" released by "delete_volume" :: held 1.564s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:07:37 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-d9b256e0-5aad-4535-8ce5-d7c044319d80 tempest-VolumesTransfersV357Test-108960796 None] Created reservations ['d920e68f-a611-49d9-8df0-f00397a5acd2', '482233b5-f686-49ea-8941-886fb6ab77ad', '235dbe5e-f78c-4ba7-b849-88c251f93737', 'c62a7d1f-19ec-4598-989a-cb8c7ca1be79'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:07:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d9b256e0-5aad-4535-8ce5-d7c044319d80 tempest-VolumesTransfersV357Test-108960796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d9b256e0-5aad-4535-8ce5-d7c044319d80 tempest-VolumesTransfersV357Test-108960796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d9b256e0-5aad-4535-8ce5-d7c044319d80 tempest-VolumesTransfersV357Test-108960796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:07:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d9b256e0-5aad-4535-8ce5-d7c044319d80 tempest-VolumesTransfersV357Test-108960796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:07:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d9b256e0-5aad-4535-8ce5-d7c044319d80 tempest-VolumesTransfersV357Test-108960796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d9b256e0-5aad-4535-8ce5-d7c044319d80 tempest-VolumesTransfersV357Test-108960796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:38 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:07:38 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:38 devstack sudo[92764]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76" returned: 0 in 0.822s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.9a67f9b2-e704-4801-bdb0-318292a4114f 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:38 devstack sudo[92772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.9a67f9b2-e704-4801-bdb0-318292a4114f 1G Jul 03 01:07:38 devstack sudo[92772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:38 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d9b256e0-5aad-4535-8ce5-d7c044319d80 tempest-VolumesTransfersV357Test-108960796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.693s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:38 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-d9b256e0-5aad-4535-8ce5-d7c044319d80 tempest-VolumesTransfersV357Test-108960796 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:07:38 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d9b256e0-5aad-4535-8ce5-d7c044319d80 tempest-VolumesTransfersV357Test-108960796 None] Deleted volume successfully. Jul 03 01:07:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d9b256e0-5aad-4535-8ce5-d7c044319d80 tempest-VolumesTransfersV357Test-108960796 None] Lock "cinder-5c0fed02-a6d1-4b7e-b902-f1dd664f9f71-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:07:39 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:07:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Flow 'volume_create_manager' (4ed7233e-367d-4436-8551-89e91b8d58bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:07:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2241d8e6-742f-4334-a8c7-196b380b241a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2241d8e6-742f-4334-a8c7-196b380b241a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-280581930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e040ad-5529-4098-8a35-cb45de87b735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df66b14ce0d6491d9f6dbc6055fe9ee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:39Z,use_quota=True,user_id='81657dfa878c46cab5b69177a43caad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626e6727-1153-4e2c-a341-c834d8e09b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626e6727-1153-4e2c-a341-c834d8e09b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (266bdc9f-6081-43a1-924d-526895ae751a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (266bdc9f-6081-43a1-924d-526895ae751a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17e040ad-5529-4098-8a35-cb45de87b735', 'volume_name': 'volume-17e040ad-5529-4098-8a35-cb45de87b735', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a05891e-253d-432c-95af-e752b3374b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a05891e-253d-432c-95af-e752b3374b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfeebc24-9543-413a-9fec-da7b93332bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:39 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Volume 17e040ad-5529-4098-8a35-cb45de87b735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17e040ad-5529-4098-8a35-cb45de87b735', 'volume_size': 1} Jul 03 01:07:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:39 devstack sudo[92772]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.9a67f9b2-e704-4801-bdb0-318292a4114f 1G" returned: 0 in 0.898s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d95dd82-3365-4dff-bef4-0ad274ebec76 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.9a67f9b2-e704-4801-bdb0-318292a4114f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:39 devstack sudo[92778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d95dd82-3365-4dff-bef4-0ad274ebec76 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.9a67f9b2-e704-4801-bdb0-318292a4114f Jul 03 01:07:39 devstack sudo[92778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:39 devstack sudo[92778]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d95dd82-3365-4dff-bef4-0ad274ebec76 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.9a67f9b2-e704-4801-bdb0-318292a4114f" returned: 0 in 0.701s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:39 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.9a67f9b2-e704-4801-bdb0-318292a4114f is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:07:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.9a67f9b2-e704-4801-bdb0-318292a4114f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:40 devstack sudo[92784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.9a67f9b2-e704-4801-bdb0-318292a4114f Jul 03 01:07:40 devstack sudo[92784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:40 devstack sudo[92784]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.9a67f9b2-e704-4801-bdb0-318292a4114f" returned: 0 in 0.780s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:40 devstack sudo[92787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.info Jul 03 01:07:40 devstack sudo[92787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:41 devstack sudo[92787]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.info" returned: 0 in 0.767s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:41 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:07:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:41 devstack sudo[92791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.info Jul 03 01:07:41 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:42 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.info" returned: 0 in 0.907s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Acquiring lock "cinder-quobyte-ad16ae67-1115-4599-ad2b-d16b5ed242d2" by "_copy_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:07:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Lock "cinder-quobyte-ad16ae67-1115-4599-ad2b-d16b5ed242d2" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:07:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] snapshot: 9a67f9b2-e704-4801-bdb0-318292a4114f, volume: ad16ae67-1115-4599-ad2b-d16b5ed242d2, {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 01:07:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:07:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:07:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:42 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[093df18e-f9dd-42df-8bbd-32dd669800ef]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:07:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.9a67f9b2-e704-4801-bdb0-318292a4114f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:42 devstack sudo[92811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.9a67f9b2-e704-4801-bdb0-318292a4114f Jul 03 01:07:42 devstack sudo[92811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:43 devstack sudo[92811]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.9a67f9b2-e704-4801-bdb0-318292a4114f" returned: 0 in 0.798s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d95dd82-3365-4dff-bef4-0ad274ebec76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:07:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76 {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 01:07:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Creating direct copy from snapshot {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 01:07:43 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[32361fbb-934a-48f2-a4ab-28786518cf28]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:07:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:43 devstack sudo[92817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76 Jul 03 01:07:43 devstack sudo[92817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:44 devstack sudo[92817]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76" returned: 0 in 0.796s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:44 devstack cinder-volume[86772]: DEBUG cinder.utils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Path /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ad16ae67-1115-4599-ad2b-d16b5ed242d2 not found in is_blk_device check {{(pid=86772) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 01:07:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ad16ae67-1115-4599-ad2b-d16b5ed242d2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:44 devstack sudo[92822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ad16ae67-1115-4599-ad2b-d16b5ed242d2 Jul 03 01:07:44 devstack sudo[92822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:50 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=11,cinder:SELECT=13,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:07:50 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=12,cinder:SELECT=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:07:51 devstack sudo[92822]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ad16ae67-1115-4599-ad2b-d16b5ed242d2" returned: 0 in 6.946s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:51 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c262c48-35ec-4b30-a24e-fdf5df018ed3]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:07:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:51 devstack sudo[92924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76 Jul 03 01:07:51 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:52 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76" returned: 0 in 1.598s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:52 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Image conversion details: src /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76, size 1024.00 MB, duration 6.95 sec, destination /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ad16ae67-1115-4599-ad2b-d16b5ed242d2 {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:07:52 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Converted 1024.00 MB image at 147.39 MB/s Jul 03 01:07:52 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ad16ae67-1115-4599-ad2b-d16b5ed242d2 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:07:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ad16ae67-1115-4599-ad2b-d16b5ed242d2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:52 devstack sudo[92965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ad16ae67-1115-4599-ad2b-d16b5ed242d2 Jul 03 01:07:52 devstack sudo[92965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:53 devstack sudo[92965]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ad16ae67-1115-4599-ad2b-d16b5ed242d2" returned: 0 in 0.772s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Lock "cinder-quobyte-ad16ae67-1115-4599-ad2b-d16b5ed242d2" released by "_copy_volume_from_snapshot" :: held 10.994s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:07:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Acquiring lock "cinder-quobyte-9a67f9b2-e704-4801-bdb0-318292a4114f" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:07:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Lock "cinder-quobyte-9a67f9b2-e704-4801-bdb0-318292a4114f" acquired by "_delete_snapshot" :: waited 0.061s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:07:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Deleting offline snapshot 9a67f9b2-e704-4801-bdb0-318292a4114f of volume 2d95dd82-3365-4dff-bef4-0ad274ebec76 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:07:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] snapshot_file for this snap is: volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.9a67f9b2-e704-4801-bdb0-318292a4114f {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:07:53 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[727109a2-4022-431f-9f47-d7c09afcbf86]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:07:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.9a67f9b2-e704-4801-bdb0-318292a4114f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:53 devstack sudo[92970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.9a67f9b2-e704-4801-bdb0-318292a4114f Jul 03 01:07:53 devstack sudo[92970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:54 devstack sudo[92970]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.9a67f9b2-e704-4801-bdb0-318292a4114f" returned: 0 in 0.891s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d95dd82-3365-4dff-bef4-0ad274ebec76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:07:54 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2111a5-641a-417f-be27-0f5be878552b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:07:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:54 devstack sudo[92977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76 Jul 03 01:07:54 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:55 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76" returned: 0 in 0.871s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.9a67f9b2-e704-4801-bdb0-318292a4114f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:55 devstack sudo[92983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.9a67f9b2-e704-4801-bdb0-318292a4114f Jul 03 01:07:55 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:56 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.9a67f9b2-e704-4801-bdb0-318292a4114f" returned: 0 in 0.797s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.9a67f9b2-e704-4801-bdb0-318292a4114f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:56 devstack sudo[92989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.9a67f9b2-e704-4801-bdb0-318292a4114f Jul 03 01:07:56 devstack sudo[92989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:57 devstack sudo[92989]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76.9a67f9b2-e704-4801-bdb0-318292a4114f" returned: 0 in 0.849s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Lock "cinder-quobyte-9a67f9b2-e704-4801-bdb0-318292a4114f" released by "_delete_snapshot" :: held 3.602s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:07:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.771s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.134s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-280581930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e040ad-5529-4098-8a35-cb45de87b735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df66b14ce0d6491d9f6dbc6055fe9ee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:07:39Z,use_quota=True,user_id='81657dfa878c46cab5b69177a43caad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:07:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Creating volume 17e040ad-5529-4098-8a35-cb45de87b735 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:07:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:07:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:07:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:07:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:07:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:07:57 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:07:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-17e040ad-5529-4098-8a35-cb45de87b735 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:57 devstack sudo[93007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-17e040ad-5529-4098-8a35-cb45de87b735 1073741824 Jul 03 01:07:57 devstack sudo[93007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:57 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8c006e1e-5f62-4074-a09d-1770f6ef1750 tempest-GroupsV314Test-1380891647 None] Create group from source-group-5f00cfb9-21c7-4584-9479-5e99f71518db completed successfully. Jul 03 01:07:58 devstack sudo[93007]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-17e040ad-5529-4098-8a35-cb45de87b735 1073741824" returned: 0 in 0.903s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-17e040ad-5529-4098-8a35-cb45de87b735 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:58 devstack sudo[93012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-17e040ad-5529-4098-8a35-cb45de87b735 Jul 03 01:07:58 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bc2196d8-7495-49ad-833c-d67b75d41316 tempest-GroupsV314Test-1380891647 None] Acquiring lock "cinder-quobyte-ad16ae67-1115-4599-ad2b-d16b5ed242d2" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:07:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bc2196d8-7495-49ad-833c-d67b75d41316 tempest-GroupsV314Test-1380891647 None] Lock "cinder-quobyte-ad16ae67-1115-4599-ad2b-d16b5ed242d2" acquired by "delete_volume" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:07:58 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root Jul 03 01:07:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-17e040ad-5529-4098-8a35-cb45de87b735" returned: 0 in 0.770s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:07:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:07:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:07:59 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60aaca6-f7d5-409c-b99a-8e64821449b6]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:07:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bc2196d8-7495-49ad-833c-d67b75d41316 tempest-GroupsV314Test-1380891647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ad16ae67-1115-4599-ad2b-d16b5ed242d2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:07:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfeebc24-9543-413a-9fec-da7b93332bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17e040ad-5529-4098-8a35-cb45de87b735', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d506b25-cafe-496d-91c9-5a19548e8379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:07:59 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Volume volume-17e040ad-5529-4098-8a35-cb45de87b735 (17e040ad-5529-4098-8a35-cb45de87b735): created successfully Jul 03 01:07:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d506b25-cafe-496d-91c9-5a19548e8379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:07:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Flow 'volume_create_manager' (4ed7233e-367d-4436-8551-89e91b8d58bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:07:59 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4eecc17c-5405-4f46-9c9e-42e7f6e0b636 tempest-VolumesTransfersV357Test-7886453 None] Created volume successfully. Jul 03 01:07:59 devstack sudo[93015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ad16ae67-1115-4599-ad2b-d16b5ed242d2 Jul 03 01:07:59 devstack sudo[93015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:07:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7d62fce8-d13f-48b2-800f-6514902fe1f3 tempest-VolumesTransfersV357Test-108960796 None] Acquiring lock "cinder-17e040ad-5529-4098-8a35-cb45de87b735-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:07:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7d62fce8-d13f-48b2-800f-6514902fe1f3 tempest-VolumesTransfersV357Test-108960796 None] Lock "cinder-17e040ad-5529-4098-8a35-cb45de87b735-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:07:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7d62fce8-d13f-48b2-800f-6514902fe1f3 tempest-VolumesTransfersV357Test-108960796 None] Acquiring lock "cinder-quobyte-17e040ad-5529-4098-8a35-cb45de87b735" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:07:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7d62fce8-d13f-48b2-800f-6514902fe1f3 tempest-VolumesTransfersV357Test-108960796 None] Lock "cinder-quobyte-17e040ad-5529-4098-8a35-cb45de87b735" acquired by "delete_volume" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:08:00 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c870c9-de18-4fcb-9217-0e05d3f4edcc]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:08:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7d62fce8-d13f-48b2-800f-6514902fe1f3 tempest-VolumesTransfersV357Test-108960796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-17e040ad-5529-4098-8a35-cb45de87b735 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:00 devstack sudo[93015]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bc2196d8-7495-49ad-833c-d67b75d41316 tempest-GroupsV314Test-1380891647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ad16ae67-1115-4599-ad2b-d16b5ed242d2" returned: 0 in 1.065s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bc2196d8-7495-49ad-833c-d67b75d41316 tempest-GroupsV314Test-1380891647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ad16ae67-1115-4599-ad2b-d16b5ed242d2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:00 devstack sudo[93021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ad16ae67-1115-4599-ad2b-d16b5ed242d2 Jul 03 01:08:00 devstack sudo[93021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:00 devstack sudo[93020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-17e040ad-5529-4098-8a35-cb45de87b735 Jul 03 01:08:00 devstack sudo[93020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:00 devstack sudo[93020]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7d62fce8-d13f-48b2-800f-6514902fe1f3 tempest-VolumesTransfersV357Test-108960796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-17e040ad-5529-4098-8a35-cb45de87b735" returned: 0 in 0.887s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7d62fce8-d13f-48b2-800f-6514902fe1f3 tempest-VolumesTransfersV357Test-108960796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-17e040ad-5529-4098-8a35-cb45de87b735 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:00 devstack sudo[93029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-17e040ad-5529-4098-8a35-cb45de87b735 Jul 03 01:08:00 devstack sudo[93029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:01 devstack sudo[93021]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bc2196d8-7495-49ad-833c-d67b75d41316 tempest-GroupsV314Test-1380891647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ad16ae67-1115-4599-ad2b-d16b5ed242d2" returned: 0 in 0.948s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-bc2196d8-7495-49ad-833c-d67b75d41316 tempest-GroupsV314Test-1380891647 None] Lock "cinder-quobyte-ad16ae67-1115-4599-ad2b-d16b5ed242d2" released by "delete_volume" :: held 2.082s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:08:01 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-bc2196d8-7495-49ad-833c-d67b75d41316 tempest-GroupsV314Test-1380891647 None] Created reservations ['8cb58cca-0c3b-4ee8-8e2b-ef2e342474d9'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:08:01 devstack cinder-volume[86772]: WARNING cinder.quota [None req-bc2196d8-7495-49ad-833c-d67b75d41316 tempest-GroupsV314Test-1380891647 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1146797867 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1146797867, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:08:01 devstack cinder-volume[86772]: WARNING cinder.quota [None req-bc2196d8-7495-49ad-833c-d67b75d41316 tempest-GroupsV314Test-1380891647 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1146797867 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1146797867, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:08:01 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-bc2196d8-7495-49ad-833c-d67b75d41316 tempest-GroupsV314Test-1380891647 None] Created reservations ['e934c9de-19fe-40f4-b5db-0ab68a1c89df', '88d149d2-4cbb-4d71-82c5-33bfe61a00e7', '2108bef5-3b79-48c9-b49b-9e5cf08a6854', 'c47411be-408d-456b-887f-765aeeb27982'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:08:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bc2196d8-7495-49ad-833c-d67b75d41316 tempest-GroupsV314Test-1380891647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bc2196d8-7495-49ad-833c-d67b75d41316 tempest-GroupsV314Test-1380891647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-bc2196d8-7495-49ad-833c-d67b75d41316 tempest-GroupsV314Test-1380891647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:08:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-bc2196d8-7495-49ad-833c-d67b75d41316 tempest-GroupsV314Test-1380891647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:08:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bc2196d8-7495-49ad-833c-d67b75d41316 tempest-GroupsV314Test-1380891647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bc2196d8-7495-49ad-833c-d67b75d41316 tempest-GroupsV314Test-1380891647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:01 devstack sudo[93032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:08:01 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:01 devstack sudo[93029]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7d62fce8-d13f-48b2-800f-6514902fe1f3 tempest-VolumesTransfersV357Test-108960796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-17e040ad-5529-4098-8a35-cb45de87b735" returned: 0 in 0.725s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7d62fce8-d13f-48b2-800f-6514902fe1f3 tempest-VolumesTransfersV357Test-108960796 None] Lock "cinder-quobyte-17e040ad-5529-4098-8a35-cb45de87b735" released by "delete_volume" :: held 1.678s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:08:01 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-7d62fce8-d13f-48b2-800f-6514902fe1f3 tempest-VolumesTransfersV357Test-108960796 None] Created reservations ['cb3ec8c5-4468-4fa6-98c2-c4333f86fab1', '61155d63-1abf-4011-a0a4-084e87456cc5', '07d93ad3-2d0a-4fa6-a720-3acb13e2b0ae', 'ba00be9c-f481-4c42-bc81-9e62e9460b1c'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:08:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7d62fce8-d13f-48b2-800f-6514902fe1f3 tempest-VolumesTransfersV357Test-108960796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7d62fce8-d13f-48b2-800f-6514902fe1f3 tempest-VolumesTransfersV357Test-108960796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7d62fce8-d13f-48b2-800f-6514902fe1f3 tempest-VolumesTransfersV357Test-108960796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:08:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7d62fce8-d13f-48b2-800f-6514902fe1f3 tempest-VolumesTransfersV357Test-108960796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:08:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7d62fce8-d13f-48b2-800f-6514902fe1f3 tempest-VolumesTransfersV357Test-108960796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7d62fce8-d13f-48b2-800f-6514902fe1f3 tempest-VolumesTransfersV357Test-108960796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9af179d2-a0e6-4f5e-810a-6076e9ddbdcf tempest-GroupsV314Test-1380891647 None] Acquiring lock "cinder-quobyte-2d95dd82-3365-4dff-bef4-0ad274ebec76" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:08:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9af179d2-a0e6-4f5e-810a-6076e9ddbdcf tempest-GroupsV314Test-1380891647 None] Lock "cinder-quobyte-2d95dd82-3365-4dff-bef4-0ad274ebec76" acquired by "delete_volume" :: waited 0.038s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:08:02 devstack sudo[93035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:08:02 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:02 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f0f11d-1614-4a60-a548-f3432b323560]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:08:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9af179d2-a0e6-4f5e-810a-6076e9ddbdcf tempest-GroupsV314Test-1380891647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:02 devstack sudo[93047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76 Jul 03 01:08:02 devstack sudo[93047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:02 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-e2c0b37b-c0f0-417a-8a27-c390faccbc10 req-29770005-6ca6-41e9-b4f8-5cf01a13da4e tempest-AttachVolumeNegativeTest-1857772135 None] Terminate volume connection completed successfully. Jul 03 01:08:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-e2c0b37b-c0f0-417a-8a27-c390faccbc10 req-29770005-6ca6-41e9-b4f8-5cf01a13da4e tempest-AttachVolumeNegativeTest-1857772135 None] Deleting attachment caf575bb-d3ab-4967-b32f-bed70edde3a1. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:08:02 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bc2196d8-7495-49ad-833c-d67b75d41316 tempest-GroupsV314Test-1380891647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.268s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:02 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-bc2196d8-7495-49ad-833c-d67b75d41316 tempest-GroupsV314Test-1380891647 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:08:02 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-bc2196d8-7495-49ad-833c-d67b75d41316 tempest-GroupsV314Test-1380891647 None] Delete group completed successfully. Jul 03 01:08:02 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7d62fce8-d13f-48b2-800f-6514902fe1f3 tempest-VolumesTransfersV357Test-108960796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.011s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:02 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-7d62fce8-d13f-48b2-800f-6514902fe1f3 tempest-VolumesTransfersV357Test-108960796 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:08:02 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7d62fce8-d13f-48b2-800f-6514902fe1f3 tempest-VolumesTransfersV357Test-108960796 None] Deleted volume successfully. Jul 03 01:08:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7d62fce8-d13f-48b2-800f-6514902fe1f3 tempest-VolumesTransfersV357Test-108960796 None] Lock "cinder-17e040ad-5529-4098-8a35-cb45de87b735-delete_volume" released by "delete_volume" :: held 3.124s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:08:03 devstack sudo[93047]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9af179d2-a0e6-4f5e-810a-6076e9ddbdcf tempest-GroupsV314Test-1380891647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76" returned: 0 in 1.109s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9af179d2-a0e6-4f5e-810a-6076e9ddbdcf tempest-GroupsV314Test-1380891647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:03 devstack sudo[93071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76 Jul 03 01:08:03 devstack sudo[93071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:03 devstack sudo[93071]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9af179d2-a0e6-4f5e-810a-6076e9ddbdcf tempest-GroupsV314Test-1380891647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d95dd82-3365-4dff-bef4-0ad274ebec76" returned: 0 in 0.649s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9af179d2-a0e6-4f5e-810a-6076e9ddbdcf tempest-GroupsV314Test-1380891647 None] Lock "cinder-quobyte-2d95dd82-3365-4dff-bef4-0ad274ebec76" released by "delete_volume" :: held 1.890s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:08:03 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-9af179d2-a0e6-4f5e-810a-6076e9ddbdcf tempest-GroupsV314Test-1380891647 None] Created reservations ['17bd775c-64a5-41f9-9da4-64c0fb98c816'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:08:04 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-9af179d2-a0e6-4f5e-810a-6076e9ddbdcf tempest-GroupsV314Test-1380891647 None] Created reservations ['9585aff9-0efa-4efb-9cff-5653685545cd', '63fcfcaa-e141-4f3d-b5ef-d1f4b1d962f0', 'e66d0986-0dc9-4e16-a999-62e054397a03', '18e12795-743f-49e2-aae0-29a647e460e8'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:08:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9af179d2-a0e6-4f5e-810a-6076e9ddbdcf tempest-GroupsV314Test-1380891647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9af179d2-a0e6-4f5e-810a-6076e9ddbdcf tempest-GroupsV314Test-1380891647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9af179d2-a0e6-4f5e-810a-6076e9ddbdcf tempest-GroupsV314Test-1380891647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:08:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9af179d2-a0e6-4f5e-810a-6076e9ddbdcf tempest-GroupsV314Test-1380891647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:08:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9af179d2-a0e6-4f5e-810a-6076e9ddbdcf tempest-GroupsV314Test-1380891647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9af179d2-a0e6-4f5e-810a-6076e9ddbdcf tempest-GroupsV314Test-1380891647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:04 devstack sudo[93108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:08:04 devstack sudo[93108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:05 devstack sudo[93108]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9af179d2-a0e6-4f5e-810a-6076e9ddbdcf tempest-GroupsV314Test-1380891647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.966s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:05 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-9af179d2-a0e6-4f5e-810a-6076e9ddbdcf tempest-GroupsV314Test-1380891647 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:08:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9af179d2-a0e6-4f5e-810a-6076e9ddbdcf tempest-GroupsV314Test-1380891647 None] Delete group completed successfully. Jul 03 01:08:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:08:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:08:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:08:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:12 devstack sudo[93161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:08:12 devstack sudo[93161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:13 devstack sudo[93161]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.897s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:08:13 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:08:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:08:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:08:14 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=37,cinder:SELECT=26,cinder:INSERT=10,cinder:DELETE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:08:14 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=34,cinder:SELECT=25,cinder:DELETE=1,cinder:INSERT=5 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:08:14 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:08:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Flow 'volume_create_manager' (9cd5c2aa-c29e-414d-9466-e3faea3c74e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:08:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b8db21-b1f1-4751-b651-372e1dbdaa52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b8db21-b1f1-4751-b651-372e1dbdaa52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-949807104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6ee81bd-51d5-40c2-b085-967491b4016e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79fc1d73c91e45608713b93aa9e2b90c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:08:14Z,use_quota=True,user_id='716708b70f254fcdbd62dad3e2d64d30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2724359-3528-4966-871c-572ee6d53cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2724359-3528-4966-871c-572ee6d53cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4e136c-30b9-42e0-8d94-bd68b3ed6cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4e136c-30b9-42e0-8d94-bd68b3ed6cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6ee81bd-51d5-40c2-b085-967491b4016e', 'volume_name': 'volume-e6ee81bd-51d5-40c2-b085-967491b4016e', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f35b67-74e1-4b3d-b94d-9426224820b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f35b67-74e1-4b3d-b94d-9426224820b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (216e55d4-2d32-482d-b109-a2a7d435f4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:14 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Volume e6ee81bd-51d5-40c2-b085-967491b4016e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6ee81bd-51d5-40c2-b085-967491b4016e', 'volume_size': 1} Jul 03 01:08:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-949807104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6ee81bd-51d5-40c2-b085-967491b4016e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79fc1d73c91e45608713b93aa9e2b90c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:08:14Z,use_quota=True,user_id='716708b70f254fcdbd62dad3e2d64d30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:08:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Creating volume e6ee81bd-51d5-40c2-b085-967491b4016e {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:08:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:08:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:08:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:08:14 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:08:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6ee81bd-51d5-40c2-b085-967491b4016e 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:14 devstack sudo[93170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6ee81bd-51d5-40c2-b085-967491b4016e 1073741824 Jul 03 01:08:14 devstack sudo[93170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:15 devstack sudo[93170]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6ee81bd-51d5-40c2-b085-967491b4016e 1073741824" returned: 0 in 1.054s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6ee81bd-51d5-40c2-b085-967491b4016e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:15 devstack sudo[93176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6ee81bd-51d5-40c2-b085-967491b4016e Jul 03 01:08:15 devstack sudo[93176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:16 devstack sudo[93176]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6ee81bd-51d5-40c2-b085-967491b4016e" returned: 0 in 0.778s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:08:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (216e55d4-2d32-482d-b109-a2a7d435f4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6ee81bd-51d5-40c2-b085-967491b4016e', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (649868c1-c62d-49c6-85c5-c7352c67b038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:16 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Volume volume-e6ee81bd-51d5-40c2-b085-967491b4016e (e6ee81bd-51d5-40c2-b085-967491b4016e): created successfully Jul 03 01:08:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (649868c1-c62d-49c6-85c5-c7352c67b038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Flow 'volume_create_manager' (9cd5c2aa-c29e-414d-9466-e3faea3c74e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:08:16 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-55167ad1-dbc3-452f-8bc6-9a79a3993fa4 tempest-AttachVolumeShelveTestJSON-1804839078 None] Created volume successfully. Jul 03 01:08:21 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:08:21 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Flow 'volume_create_manager' (69eb13f2-b622-449b-ae7a-7d37c3660556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:08:21 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65448c93-c5cf-4f45-888e-1990fc6023aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:21 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65448c93-c5cf-4f45-888e-1990fc6023aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1312360180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d2744e-b97c-467e-ac18-acffce8e95d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='933cd0259de84e7e91b05c403597ebbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:08:22Z,use_quota=True,user_id='9fbd00e94b1544b8a4a6c14dc1a60b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:21 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de808b8-6d96-4e52-a786-31d54d9876d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:21 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de808b8-6d96-4e52-a786-31d54d9876d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:21 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (979e9241-e3f4-4d3a-a807-8b899041dd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:21 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (979e9241-e3f4-4d3a-a807-8b899041dd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04d2744e-b97c-467e-ac18-acffce8e95d1', 'volume_name': 'volume-04d2744e-b97c-467e-ac18-acffce8e95d1', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:21 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7cf30f5-578d-4117-ae59-1f0b784563d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:21 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7cf30f5-578d-4117-ae59-1f0b784563d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:21 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96496ac8-5fd3-46e8-9a5a-c93952825a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:21 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Volume 04d2744e-b97c-467e-ac18-acffce8e95d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04d2744e-b97c-467e-ac18-acffce8e95d1', 'volume_size': 1} Jul 03 01:08:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1312360180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d2744e-b97c-467e-ac18-acffce8e95d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='933cd0259de84e7e91b05c403597ebbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:08:22Z,use_quota=True,user_id='9fbd00e94b1544b8a4a6c14dc1a60b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:08:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Creating volume 04d2744e-b97c-467e-ac18-acffce8e95d1 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:08:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:08:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:08:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:08:21 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:08:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:21 devstack sudo[93228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 1073741824 Jul 03 01:08:21 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:22 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:08:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Flow 'volume_create_manager' (c9deac8c-b31e-46ae-9e97-24fabb604386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:08:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a526a46f-4aa3-4393-a123-d925d7da8003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a526a46f-4aa3-4393-a123-d925d7da8003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2038783477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3716c6-f365-437e-a381-470e07f01d8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67260236144a4f0e925e9565f4fbfb5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:08:22Z,use_quota=True,user_id='177192bb174340d6814242298b851f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91e40372-a91e-4aad-97f9-da659eb68748),volume_type_id=91e40372-a91e-4aad-97f9-da659eb68748)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84eb94c7-3263-4993-b3b2-9ff3fa74a291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84eb94c7-3263-4993-b3b2-9ff3fa74a291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ee669c-836c-496f-9f8b-0f3d9b65affa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ee669c-836c-496f-9f8b-0f3d9b65affa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b3716c6-f365-437e-a381-470e07f01d8b', 'volume_name': 'volume-5b3716c6-f365-437e-a381-470e07f01d8b', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f44f8d4-f2bd-461d-b72c-bc15a05eda02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f44f8d4-f2bd-461d-b72c-bc15a05eda02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7afad205-4257-44a6-bda8-200ae1e7e714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:22 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Volume 5b3716c6-f365-437e-a381-470e07f01d8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b3716c6-f365-437e-a381-470e07f01d8b', 'volume_size': 1} Jul 03 01:08:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:22 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 1073741824" returned: 0 in 0.986s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:22 devstack sudo[93238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 Jul 03 01:08:22 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:23 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1" returned: 0 in 0.709s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:08:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.305s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2038783477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3716c6-f365-437e-a381-470e07f01d8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67260236144a4f0e925e9565f4fbfb5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:08:22Z,use_quota=True,user_id='177192bb174340d6814242298b851f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91e40372-a91e-4aad-97f9-da659eb68748),volume_type_id=91e40372-a91e-4aad-97f9-da659eb68748)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:08:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Creating volume 5b3716c6-f365-437e-a381-470e07f01d8b {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:08:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:08:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:08:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:08:23 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:08:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5b3716c6-f365-437e-a381-470e07f01d8b 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:23 devstack sudo[93251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5b3716c6-f365-437e-a381-470e07f01d8b 1073741824 Jul 03 01:08:23 devstack sudo[93251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96496ac8-5fd3-46e8-9a5a-c93952825a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04d2744e-b97c-467e-ac18-acffce8e95d1', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66cf9a56-ec4f-41e6-8120-beb059d7a93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:23 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Volume volume-04d2744e-b97c-467e-ac18-acffce8e95d1 (04d2744e-b97c-467e-ac18-acffce8e95d1): created successfully Jul 03 01:08:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66cf9a56-ec4f-41e6-8120-beb059d7a93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Flow 'volume_create_manager' (69eb13f2-b622-449b-ae7a-7d37c3660556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:08:23 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-2ca05361-9f07-4259-b416-408a5e5f139b tempest-VolumesActionsTest-565573594 None] Created volume successfully. Jul 03 01:08:24 devstack sudo[93251]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5b3716c6-f365-437e-a381-470e07f01d8b 1073741824" returned: 0 in 0.909s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5b3716c6-f365-437e-a381-470e07f01d8b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:24 devstack sudo[93257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5b3716c6-f365-437e-a381-470e07f01d8b Jul 03 01:08:24 devstack sudo[93257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:25 devstack sudo[93257]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5b3716c6-f365-437e-a381-470e07f01d8b" returned: 0 in 0.913s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:08:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7afad205-4257-44a6-bda8-200ae1e7e714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b3716c6-f365-437e-a381-470e07f01d8b', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e30933-9824-4b06-b1f6-6ba501e408c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:25 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Volume volume-5b3716c6-f365-437e-a381-470e07f01d8b (5b3716c6-f365-437e-a381-470e07f01d8b): created successfully Jul 03 01:08:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e30933-9824-4b06-b1f6-6ba501e408c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Flow 'volume_create_manager' (c9deac8c-b31e-46ae-9e97-24fabb604386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:08:25 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-832a3ce2-24cf-4622-91d3-82ca3f0cf804 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Created volume successfully. Jul 03 01:08:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a1681592-0aa7-4cfe-a432-53d086ffa845 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a1681592-0aa7-4cfe-a432-53d086ffa845 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a1681592-0aa7-4cfe-a432-53d086ffa845 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:08:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a1681592-0aa7-4cfe-a432-53d086ffa845 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:08:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a1681592-0aa7-4cfe-a432-53d086ffa845 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a1681592-0aa7-4cfe-a432-53d086ffa845 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:27 devstack sudo[93265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:08:27 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:28 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a1681592-0aa7-4cfe-a432-53d086ffa845 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.098s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:28 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-a1681592-0aa7-4cfe-a432-53d086ffa845 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:08:28 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a1681592-0aa7-4cfe-a432-53d086ffa845 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Retype volume completed successfully. Jul 03 01:08:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1460d17f-453c-44af-8366-4f17037ed821 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Acquiring lock "cinder-5b3716c6-f365-437e-a381-470e07f01d8b-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:08:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1460d17f-453c-44af-8366-4f17037ed821 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Lock "cinder-5b3716c6-f365-437e-a381-470e07f01d8b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:08:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1460d17f-453c-44af-8366-4f17037ed821 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Acquiring lock "cinder-quobyte-5b3716c6-f365-437e-a381-470e07f01d8b" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:08:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1460d17f-453c-44af-8366-4f17037ed821 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Lock "cinder-quobyte-5b3716c6-f365-437e-a381-470e07f01d8b" acquired by "delete_volume" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:08:28 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[735187bc-ba7a-4e49-a29f-5f5502853356]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:08:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1460d17f-453c-44af-8366-4f17037ed821 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5b3716c6-f365-437e-a381-470e07f01d8b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:29 devstack sudo[93283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5b3716c6-f365-437e-a381-470e07f01d8b Jul 03 01:08:29 devstack sudo[93283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:29 devstack sudo[93283]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1460d17f-453c-44af-8366-4f17037ed821 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5b3716c6-f365-437e-a381-470e07f01d8b" returned: 0 in 0.761s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1460d17f-453c-44af-8366-4f17037ed821 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5b3716c6-f365-437e-a381-470e07f01d8b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:29 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5b3716c6-f365-437e-a381-470e07f01d8b Jul 03 01:08:29 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:30 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1460d17f-453c-44af-8366-4f17037ed821 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5b3716c6-f365-437e-a381-470e07f01d8b" returned: 0 in 0.680s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1460d17f-453c-44af-8366-4f17037ed821 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Lock "cinder-quobyte-5b3716c6-f365-437e-a381-470e07f01d8b" released by "delete_volume" :: held 1.487s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:08:30 devstack cinder-volume[86772]: WARNING cinder.quota [None req-1460d17f-453c-44af-8366-4f17037ed821 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:08:30 devstack cinder-volume[86772]: WARNING cinder.quota [None req-1460d17f-453c-44af-8366-4f17037ed821 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:08:30 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-1460d17f-453c-44af-8366-4f17037ed821 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Created reservations ['727a93f3-0d4d-482d-9731-0e0497278b36', '39f15d46-ea8f-4a4b-b87f-3cca91b23de0', 'af4f2139-ebf3-42ee-a154-093a73843894', 'b1e4c279-24b5-436b-895a-c5648baf22e2'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:08:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1460d17f-453c-44af-8366-4f17037ed821 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1460d17f-453c-44af-8366-4f17037ed821 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1460d17f-453c-44af-8366-4f17037ed821 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:08:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1460d17f-453c-44af-8366-4f17037ed821 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:08:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1460d17f-453c-44af-8366-4f17037ed821 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1460d17f-453c-44af-8366-4f17037ed821 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:30 devstack sudo[93292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:08:30 devstack sudo[93292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:31 devstack sudo[93292]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1460d17f-453c-44af-8366-4f17037ed821 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.877s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:31 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-1460d17f-453c-44af-8366-4f17037ed821 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:08:31 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1460d17f-453c-44af-8366-4f17037ed821 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Deleted volume successfully. Jul 03 01:08:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1460d17f-453c-44af-8366-4f17037ed821 tempest-VolumeRetypeWithoutMigrationTest-289483172 None] Lock "cinder-5b3716c6-f365-437e-a381-470e07f01d8b-delete_volume" released by "delete_volume" :: held 2.630s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:08:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-c4efc098-af63-41be-ba40-aa32c96237bc req-b9ef0c18-dff9-4645-9d7d-e20ec35c9b7f tempest-AttachVolumeShelveTestJSON-1804839078 None] No connector for attachment 30af7c07-0af7-41e1-92cc-34723bd53760; skipping storage backend terminate_connection call. {{(pid=86772) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 03 01:08:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-c4efc098-af63-41be-ba40-aa32c96237bc req-b9ef0c18-dff9-4645-9d7d-e20ec35c9b7f tempest-AttachVolumeShelveTestJSON-1804839078 None] Deleting attachment 30af7c07-0af7-41e1-92cc-34723bd53760. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:08:42 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:08:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Flow 'volume_create_manager' (ecc58254-8f5d-462b-aea9-78491ae416af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:08:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c656bbef-180b-4317-9c68-8986b67469c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c656bbef-180b-4317-9c68-8986b67469c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-783606706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3bf531c-b74c-4c53-a934-4117ec891e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39adc90004b141e598e5b452bb9f4eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:08:42Z,use_quota=True,user_id='187f04a88d2a4c68b4bda831ecf849ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c892ebe-16d5-4beb-a2a3-8874007e368f),volume_type_id=5c892ebe-16d5-4beb-a2a3-8874007e368f)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2efad8-cfc0-4ddd-8ac1-315ca0a32a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2efad8-cfc0-4ddd-8ac1-315ca0a32a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9653d6da-ed19-4349-9d29-8045e2db9839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9653d6da-ed19-4349-9d29-8045e2db9839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3bf531c-b74c-4c53-a934-4117ec891e53', 'volume_name': 'volume-a3bf531c-b74c-4c53-a934-4117ec891e53', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (920f4f9a-6f15-4abf-ac40-a3f129aa9620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (920f4f9a-6f15-4abf-ac40-a3f129aa9620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce760db-828b-47b0-83ca-3ef89f204172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:42 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Volume a3bf531c-b74c-4c53-a934-4117ec891e53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3bf531c-b74c-4c53-a934-4117ec891e53', 'volume_size': 1} Jul 03 01:08:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-783606706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3bf531c-b74c-4c53-a934-4117ec891e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39adc90004b141e598e5b452bb9f4eee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:08:42Z,use_quota=True,user_id='187f04a88d2a4c68b4bda831ecf849ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c892ebe-16d5-4beb-a2a3-8874007e368f),volume_type_id=5c892ebe-16d5-4beb-a2a3-8874007e368f)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:08:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Creating volume a3bf531c-b74c-4c53-a934-4117ec891e53 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:08:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:08:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:08:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:08:42 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:08:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a3bf531c-b74c-4c53-a934-4117ec891e53 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:42 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a3bf531c-b74c-4c53-a934-4117ec891e53 1073741824 Jul 03 01:08:42 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:43 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a3bf531c-b74c-4c53-a934-4117ec891e53 1073741824" returned: 0 in 1.234s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a3bf531c-b74c-4c53-a934-4117ec891e53 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:43 devstack sudo[93477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a3bf531c-b74c-4c53-a934-4117ec891e53 Jul 03 01:08:43 devstack sudo[93477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:44 devstack sudo[93477]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a3bf531c-b74c-4c53-a934-4117ec891e53" returned: 0 in 0.752s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] <== create_volume: return (2085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:08:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.090s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce760db-828b-47b0-83ca-3ef89f204172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3bf531c-b74c-4c53-a934-4117ec891e53', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8009a8c6-8015-430a-a1b6-d156f2a0d6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:08:44 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Volume volume-a3bf531c-b74c-4c53-a934-4117ec891e53 (a3bf531c-b74c-4c53-a934-4117ec891e53): created successfully Jul 03 01:08:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8009a8c6-8015-430a-a1b6-d156f2a0d6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:08:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Flow 'volume_create_manager' (ecc58254-8f5d-462b-aea9-78491ae416af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:08:44 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9c870d3b-ebfe-46cd-b062-5b47e7524686 tempest-VolumeTypesAccessTest-1694603262 None] Created volume successfully. Jul 03 01:08:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8bd02713-da07-4490-bb46-3709bd2e7236 tempest-VolumesActionsTest-565573594 None] Acquiring lock "cinder-04d2744e-b97c-467e-ac18-acffce8e95d1" by "attach_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:08:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8bd02713-da07-4490-bb46-3709bd2e7236 tempest-VolumesActionsTest-565573594 None] Lock "cinder-04d2744e-b97c-467e-ac18-acffce8e95d1" acquired by "attach_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:08:45 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8bd02713-da07-4490-bb46-3709bd2e7236 tempest-VolumesActionsTest-565573594 None] Attaching volume 04d2744e-b97c-467e-ac18-acffce8e95d1 to instance 360fabce-969a-4d69-9a1e-e77cd497fb0d at mountpoint /dev/vdb on host None. Jul 03 01:08:45 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8bd02713-da07-4490-bb46-3709bd2e7236 tempest-VolumesActionsTest-565573594 None] Attach volume completed successfully. Jul 03 01:08:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8bd02713-da07-4490-bb46-3709bd2e7236 tempest-VolumesActionsTest-565573594 None] Lock "cinder-04d2744e-b97c-467e-ac18-acffce8e95d1" released by "attach_volume" :: held 0.106s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:08:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c74ea7c9-75a0-4a12-a94f-941d9b727898 tempest-VolumeTypesAccessTest-1694603262 None] Acquiring lock "cinder-a3bf531c-b74c-4c53-a934-4117ec891e53-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:08:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c74ea7c9-75a0-4a12-a94f-941d9b727898 tempest-VolumeTypesAccessTest-1694603262 None] Lock "cinder-a3bf531c-b74c-4c53-a934-4117ec891e53-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:08:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c74ea7c9-75a0-4a12-a94f-941d9b727898 tempest-VolumeTypesAccessTest-1694603262 None] Acquiring lock "cinder-quobyte-a3bf531c-b74c-4c53-a934-4117ec891e53" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:08:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c74ea7c9-75a0-4a12-a94f-941d9b727898 tempest-VolumeTypesAccessTest-1694603262 None] Lock "cinder-quobyte-a3bf531c-b74c-4c53-a934-4117ec891e53" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:08:45 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[af78651b-675b-4e0c-8b5e-6b294b5719e1]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:08:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c74ea7c9-75a0-4a12-a94f-941d9b727898 tempest-VolumeTypesAccessTest-1694603262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a3bf531c-b74c-4c53-a934-4117ec891e53 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ac5c3d7b-ab2a-4207-bfa1-7a61b6a24f13 tempest-VolumesActionsTest-565573594 None] Acquiring lock "cinder-04d2744e-b97c-467e-ac18-acffce8e95d1-detach_volume" by "detach_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:08:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ac5c3d7b-ab2a-4207-bfa1-7a61b6a24f13 tempest-VolumesActionsTest-565573594 None] Lock "cinder-04d2744e-b97c-467e-ac18-acffce8e95d1-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:08:45 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ac5c3d7b-ab2a-4207-bfa1-7a61b6a24f13 tempest-VolumesActionsTest-565573594 None] Detaching volume 04d2744e-b97c-467e-ac18-acffce8e95d1 from instance 360fabce-969a-4d69-9a1e-e77cd497fb0d. Jul 03 01:08:45 devstack sudo[93480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a3bf531c-b74c-4c53-a934-4117ec891e53 Jul 03 01:08:45 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:45 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ac5c3d7b-ab2a-4207-bfa1-7a61b6a24f13 tempest-VolumesActionsTest-565573594 None] Detach volume completed successfully. Jul 03 01:08:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ac5c3d7b-ab2a-4207-bfa1-7a61b6a24f13 tempest-VolumesActionsTest-565573594 None] Lock "cinder-04d2744e-b97c-467e-ac18-acffce8e95d1-detach_volume" released by "detach_volume" :: held 0.117s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:08:46 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c74ea7c9-75a0-4a12-a94f-941d9b727898 tempest-VolumeTypesAccessTest-1694603262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a3bf531c-b74c-4c53-a934-4117ec891e53" returned: 0 in 0.867s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c74ea7c9-75a0-4a12-a94f-941d9b727898 tempest-VolumeTypesAccessTest-1694603262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a3bf531c-b74c-4c53-a934-4117ec891e53 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:46 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a3bf531c-b74c-4c53-a934-4117ec891e53 Jul 03 01:08:46 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:47 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c74ea7c9-75a0-4a12-a94f-941d9b727898 tempest-VolumeTypesAccessTest-1694603262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a3bf531c-b74c-4c53-a934-4117ec891e53" returned: 0 in 0.861s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c74ea7c9-75a0-4a12-a94f-941d9b727898 tempest-VolumeTypesAccessTest-1694603262 None] Lock "cinder-quobyte-a3bf531c-b74c-4c53-a934-4117ec891e53" released by "delete_volume" :: held 1.795s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:08:47 devstack cinder-volume[86772]: WARNING cinder.quota [None req-c74ea7c9-75a0-4a12-a94f-941d9b727898 tempest-VolumeTypesAccessTest-1694603262 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-455266309 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-455266309, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:08:47 devstack cinder-volume[86772]: WARNING cinder.quota [None req-c74ea7c9-75a0-4a12-a94f-941d9b727898 tempest-VolumeTypesAccessTest-1694603262 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-455266309 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-455266309, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:08:47 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-c74ea7c9-75a0-4a12-a94f-941d9b727898 tempest-VolumeTypesAccessTest-1694603262 None] Created reservations ['d16fc430-7c00-4fa8-9a3f-5bb074f38c67', '3de53b04-a817-48da-a280-6c62f7b98cf0', '16cd8f71-5e88-44d3-9865-05e77cdc08fe', '4af866d7-5935-497d-b67c-5dbe06d9ad74'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:08:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c74ea7c9-75a0-4a12-a94f-941d9b727898 tempest-VolumeTypesAccessTest-1694603262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:08:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c74ea7c9-75a0-4a12-a94f-941d9b727898 tempest-VolumeTypesAccessTest-1694603262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:08:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c74ea7c9-75a0-4a12-a94f-941d9b727898 tempest-VolumeTypesAccessTest-1694603262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:08:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c74ea7c9-75a0-4a12-a94f-941d9b727898 tempest-VolumeTypesAccessTest-1694603262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:08:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c74ea7c9-75a0-4a12-a94f-941d9b727898 tempest-VolumeTypesAccessTest-1694603262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:08:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c74ea7c9-75a0-4a12-a94f-941d9b727898 tempest-VolumeTypesAccessTest-1694603262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:08:47 devstack sudo[93519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:08:47 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:08:49 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root Jul 03 01:08:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c74ea7c9-75a0-4a12-a94f-941d9b727898 tempest-VolumeTypesAccessTest-1694603262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.484s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:08:49 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-c74ea7c9-75a0-4a12-a94f-941d9b727898 tempest-VolumeTypesAccessTest-1694603262 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:08:49 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c74ea7c9-75a0-4a12-a94f-941d9b727898 tempest-VolumeTypesAccessTest-1694603262 None] Deleted volume successfully. Jul 03 01:08:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c74ea7c9-75a0-4a12-a94f-941d9b727898 tempest-VolumeTypesAccessTest-1694603262 None] Lock "cinder-a3bf531c-b74c-4c53-a934-4117ec891e53-delete_volume" released by "delete_volume" :: held 3.763s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:08:57 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=36,cinder:UPDATE=36,cinder:INSERT=9,cinder:DELETE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:08:59 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=29,cinder:UPDATE=35,cinder:DELETE=5,cinder:INSERT=5 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:09:02 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:09:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Flow 'volume_create_manager' (1396fbd9-bbe3-4088-bcca-fa8be99a32a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:09:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31dc6a3d-9120-4167-8259-4329b2d8eb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31dc6a3d-9120-4167-8259-4329b2d8eb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2083148371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=375b6927-a923-4695-ad2b-9f2651f8ee31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b133f094add64e44ad5d3ccb72702669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:02Z,use_quota=True,user_id='a01d34fd8c344fc8bcb23ceb706c3b14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30aa06fc-d130-43e2-a057-0b89720f0907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30aa06fc-d130-43e2-a057-0b89720f0907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e61e3892-16c3-41ac-923a-b6567a979a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e61e3892-16c3-41ac-923a-b6567a979a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '375b6927-a923-4695-ad2b-9f2651f8ee31', 'volume_name': 'volume-375b6927-a923-4695-ad2b-9f2651f8ee31', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (551756b2-6f3d-41e3-b578-9b503b11a56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (551756b2-6f3d-41e3-b578-9b503b11a56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf237ffa-e796-4b50-9caa-bc8e893fbb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:02 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Volume 375b6927-a923-4695-ad2b-9f2651f8ee31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-375b6927-a923-4695-ad2b-9f2651f8ee31', 'volume_size': 1} Jul 03 01:09:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:09:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:09:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2083148371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=375b6927-a923-4695-ad2b-9f2651f8ee31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b133f094add64e44ad5d3ccb72702669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:02Z,use_quota=True,user_id='a01d34fd8c344fc8bcb23ceb706c3b14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:09:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Creating volume 375b6927-a923-4695-ad2b-9f2651f8ee31 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:09:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:09:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:09:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:09:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:09:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:09:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:09:02 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:09:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-375b6927-a923-4695-ad2b-9f2651f8ee31 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:02 devstack sudo[93688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-375b6927-a923-4695-ad2b-9f2651f8ee31 1073741824 Jul 03 01:09:02 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:03 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-375b6927-a923-4695-ad2b-9f2651f8ee31 1073741824" returned: 0 in 1.503s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-375b6927-a923-4695-ad2b-9f2651f8ee31 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:03 devstack sudo[93696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-375b6927-a923-4695-ad2b-9f2651f8ee31 Jul 03 01:09:03 devstack sudo[93696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:04 devstack sudo[93696]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-375b6927-a923-4695-ad2b-9f2651f8ee31" returned: 0 in 0.953s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] <== create_volume: return (2528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:09:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.532s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:09:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf237ffa-e796-4b50-9caa-bc8e893fbb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-375b6927-a923-4695-ad2b-9f2651f8ee31', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7863bce-9ee1-48e7-937c-693aee92fbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:04 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Volume volume-375b6927-a923-4695-ad2b-9f2651f8ee31 (375b6927-a923-4695-ad2b-9f2651f8ee31): created successfully Jul 03 01:09:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7863bce-9ee1-48e7-937c-693aee92fbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Flow 'volume_create_manager' (1396fbd9-bbe3-4088-bcca-fa8be99a32a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:09:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-fe2ebf4e-6894-417b-b31d-a45588e2835b tempest-AttachVolumeNegativeTest-1857772135 None] Created volume successfully. Jul 03 01:09:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-b35c55c3-9260-4fa7-ab20-de7aa7098514 req-43a2335a-7fe0-4513-a990-e4221e26c7ff tempest-AttachVolumeNegativeTest-1857772135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:09:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-b35c55c3-9260-4fa7-ab20-de7aa7098514 req-43a2335a-7fe0-4513-a990-e4221e26c7ff tempest-AttachVolumeNegativeTest-1857772135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:09:09 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52e4e76-83e3-4b56-a8f1-4d3d625dbb62]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:09:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-b35c55c3-9260-4fa7-ab20-de7aa7098514 req-43a2335a-7fe0-4513-a990-e4221e26c7ff tempest-AttachVolumeNegativeTest-1857772135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-375b6927-a923-4695-ad2b-9f2651f8ee31 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:09 devstack sudo[93766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-375b6927-a923-4695-ad2b-9f2651f8ee31 Jul 03 01:09:09 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:10 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-b35c55c3-9260-4fa7-ab20-de7aa7098514 req-43a2335a-7fe0-4513-a990-e4221e26c7ff tempest-AttachVolumeNegativeTest-1857772135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-375b6927-a923-4695-ad2b-9f2651f8ee31" returned: 0 in 1.225s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-b35c55c3-9260-4fa7-ab20-de7aa7098514 req-43a2335a-7fe0-4513-a990-e4221e26c7ff tempest-AttachVolumeNegativeTest-1857772135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.251s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:09:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-b35c55c3-9260-4fa7-ab20-de7aa7098514 req-43a2335a-7fe0-4513-a990-e4221e26c7ff tempest-AttachVolumeNegativeTest-1857772135 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171', 'name': 'volume-375b6927-a923-4695-ad2b-9f2651f8ee31', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0ec5dd7-a01a-4a9c-8b6c-9e62771bef29', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:09:10 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-b35c55c3-9260-4fa7-ab20-de7aa7098514 req-43a2335a-7fe0-4513-a990-e4221e26c7ff tempest-AttachVolumeNegativeTest-1857772135 None] attachment_update completed successfully. Jul 03 01:09:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:09:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:09:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:09:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:09:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:09:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:09:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:12 devstack sudo[94159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:09:12 devstack sudo[94159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:13 devstack sudo[94159]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.729s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:09:13 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:09:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:09:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:09:18 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-f092a836-05db-4b5a-aa65-0fbc7b7bd859 req-79f03c2e-c9c3-4a2c-b94e-b9a8d1153a1e tempest-AttachVolumeNegativeTest-1857772135 None] Terminate volume connection completed successfully. Jul 03 01:09:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-f092a836-05db-4b5a-aa65-0fbc7b7bd859 req-79f03c2e-c9c3-4a2c-b94e-b9a8d1153a1e tempest-AttachVolumeNegativeTest-1857772135 None] Deleting attachment b0ec5dd7-a01a-4a9c-8b6c-9e62771bef29. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:09:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-096cb831-1eaf-42e2-bfc6-d08bc695e411 tempest-VolumesActionsTest-565573594 None] Acquiring lock "cinder-04d2744e-b97c-467e-ac18-acffce8e95d1" by "attach_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:09:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-096cb831-1eaf-42e2-bfc6-d08bc695e411 tempest-VolumesActionsTest-565573594 None] Lock "cinder-04d2744e-b97c-467e-ac18-acffce8e95d1" acquired by "attach_volume" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:09:19 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-096cb831-1eaf-42e2-bfc6-d08bc695e411 tempest-VolumesActionsTest-565573594 None] Attaching volume 04d2744e-b97c-467e-ac18-acffce8e95d1 to instance d621918d-ba69-4a58-a69a-ca9782be6861 at mountpoint /dev/vdb on host None. Jul 03 01:09:19 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-096cb831-1eaf-42e2-bfc6-d08bc695e411 tempest-VolumesActionsTest-565573594 None] Attach volume completed successfully. Jul 03 01:09:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-096cb831-1eaf-42e2-bfc6-d08bc695e411 tempest-VolumesActionsTest-565573594 None] Lock "cinder-04d2744e-b97c-467e-ac18-acffce8e95d1" released by "attach_volume" :: held 0.197s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:09:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-50039a72-e248-494e-b80a-55cca3f7e516 tempest-VolumesActionsTest-565573594 None] Acquiring lock "cinder-04d2744e-b97c-467e-ac18-acffce8e95d1-detach_volume" by "detach_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:09:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-50039a72-e248-494e-b80a-55cca3f7e516 tempest-VolumesActionsTest-565573594 None] Lock "cinder-04d2744e-b97c-467e-ac18-acffce8e95d1-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:09:20 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-50039a72-e248-494e-b80a-55cca3f7e516 tempest-VolumesActionsTest-565573594 None] Detaching volume 04d2744e-b97c-467e-ac18-acffce8e95d1 from instance d621918d-ba69-4a58-a69a-ca9782be6861. Jul 03 01:09:20 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-50039a72-e248-494e-b80a-55cca3f7e516 tempest-VolumesActionsTest-565573594 None] Detach volume completed successfully. Jul 03 01:09:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-50039a72-e248-494e-b80a-55cca3f7e516 tempest-VolumesActionsTest-565573594 None] Lock "cinder-04d2744e-b97c-467e-ac18-acffce8e95d1-detach_volume" released by "detach_volume" :: held 0.100s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:09:30 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=9,cinder:SELECT=13,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:09:30 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=17,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:09:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a1ac000b-f1e2-47a9-85e3-07eb450aaa87 tempest-VolumesActionsTest-565573594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:09:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a1ac000b-f1e2-47a9-85e3-07eb450aaa87 tempest-VolumesActionsTest-565573594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:09:32 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1699489b-1e05-4e16-bd61-0af6d6b95bdf]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:09:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a1ac000b-f1e2-47a9-85e3-07eb450aaa87 tempest-VolumesActionsTest-565573594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:32 devstack sudo[94406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 Jul 03 01:09:32 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:33 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a1ac000b-f1e2-47a9-85e3-07eb450aaa87 tempest-VolumesActionsTest-565573594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1" returned: 0 in 1.104s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:33 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0e29a2-c595-49c4-8f22-ceee09d96fbb]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:09:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a1ac000b-f1e2-47a9-85e3-07eb450aaa87 tempest-VolumesActionsTest-565573594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:33 devstack sudo[94419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 Jul 03 01:09:33 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:34 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a1ac000b-f1e2-47a9-85e3-07eb450aaa87 tempest-VolumesActionsTest-565573594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1" returned: 0 in 1.049s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a1ac000b-f1e2-47a9-85e3-07eb450aaa87 tempest-VolumesActionsTest-565573594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 /opt/stack/data/cinder/conversion/04d2744e-b97c-467e-ac18-acffce8e95d1.temp_image.18178a20-cdfb-4872-a2e2-f74901fd9a17h1kra4xy.img {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:34 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 /opt/stack/data/cinder/conversion/04d2744e-b97c-467e-ac18-acffce8e95d1.temp_image.18178a20-cdfb-4872-a2e2-f74901fd9a17h1kra4xy.img Jul 03 01:09:34 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-53ec0194-7e96-421a-a845-202a1e3a630b tempest-AttachVolumeShelveTestJSON-1804839078 None] Acquiring lock "cinder-e6ee81bd-51d5-40c2-b085-967491b4016e-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:09:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-53ec0194-7e96-421a-a845-202a1e3a630b tempest-AttachVolumeShelveTestJSON-1804839078 None] Lock "cinder-e6ee81bd-51d5-40c2-b085-967491b4016e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:09:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-53ec0194-7e96-421a-a845-202a1e3a630b tempest-AttachVolumeShelveTestJSON-1804839078 None] Acquiring lock "cinder-quobyte-e6ee81bd-51d5-40c2-b085-967491b4016e" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:09:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-53ec0194-7e96-421a-a845-202a1e3a630b tempest-AttachVolumeShelveTestJSON-1804839078 None] Lock "cinder-quobyte-e6ee81bd-51d5-40c2-b085-967491b4016e" acquired by "delete_volume" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:09:34 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f97d2db-d75b-4edf-bff8-23588dd92c7c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:09:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-53ec0194-7e96-421a-a845-202a1e3a630b tempest-AttachVolumeShelveTestJSON-1804839078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6ee81bd-51d5-40c2-b085-967491b4016e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:34 devstack sudo[94442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6ee81bd-51d5-40c2-b085-967491b4016e Jul 03 01:09:34 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:37 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-53ec0194-7e96-421a-a845-202a1e3a630b tempest-AttachVolumeShelveTestJSON-1804839078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6ee81bd-51d5-40c2-b085-967491b4016e" returned: 0 in 2.217s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-53ec0194-7e96-421a-a845-202a1e3a630b tempest-AttachVolumeShelveTestJSON-1804839078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6ee81bd-51d5-40c2-b085-967491b4016e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:37 devstack sudo[94458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6ee81bd-51d5-40c2-b085-967491b4016e Jul 03 01:09:37 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:39 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-53ec0194-7e96-421a-a845-202a1e3a630b tempest-AttachVolumeShelveTestJSON-1804839078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6ee81bd-51d5-40c2-b085-967491b4016e" returned: 0 in 2.321s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-53ec0194-7e96-421a-a845-202a1e3a630b tempest-AttachVolumeShelveTestJSON-1804839078 None] Lock "cinder-quobyte-e6ee81bd-51d5-40c2-b085-967491b4016e" released by "delete_volume" :: held 4.648s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:09:39 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-53ec0194-7e96-421a-a845-202a1e3a630b tempest-AttachVolumeShelveTestJSON-1804839078 None] Created reservations ['99b809bb-e049-4ee5-b7a8-dbf7bb9ef34e', '7a7ff681-9497-4c88-b4ae-e349243403e5', '16d46cde-cf74-44f9-bcc6-5c237320f42c', '4fd6abdb-119d-4500-947e-5e1d6bba2e51'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:09:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-53ec0194-7e96-421a-a845-202a1e3a630b tempest-AttachVolumeShelveTestJSON-1804839078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:09:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-53ec0194-7e96-421a-a845-202a1e3a630b tempest-AttachVolumeShelveTestJSON-1804839078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:09:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-53ec0194-7e96-421a-a845-202a1e3a630b tempest-AttachVolumeShelveTestJSON-1804839078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:09:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-53ec0194-7e96-421a-a845-202a1e3a630b tempest-AttachVolumeShelveTestJSON-1804839078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:09:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-53ec0194-7e96-421a-a845-202a1e3a630b tempest-AttachVolumeShelveTestJSON-1804839078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:09:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-53ec0194-7e96-421a-a845-202a1e3a630b tempest-AttachVolumeShelveTestJSON-1804839078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:39 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:09:39 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:41 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a1ac000b-f1e2-47a9-85e3-07eb450aaa87 tempest-VolumesActionsTest-565573594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 /opt/stack/data/cinder/conversion/04d2744e-b97c-467e-ac18-acffce8e95d1.temp_image.18178a20-cdfb-4872-a2e2-f74901fd9a17h1kra4xy.img" returned: 0 in 7.130s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:41 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ffea9e-ac33-44ab-80fc-618064dd2ed9]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:09:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a1ac000b-f1e2-47a9-85e3-07eb450aaa87 tempest-VolumesActionsTest-565573594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:09:41 devstack sudo[94545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 Jul 03 01:09:41 devstack sudo[94545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:09:41 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-53ec0194-7e96-421a-a845-202a1e3a630b tempest-AttachVolumeShelveTestJSON-1804839078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 2.030s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:41 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-53ec0194-7e96-421a-a845-202a1e3a630b tempest-AttachVolumeShelveTestJSON-1804839078 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:09:41 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-53ec0194-7e96-421a-a845-202a1e3a630b tempest-AttachVolumeShelveTestJSON-1804839078 None] Deleted volume successfully. Jul 03 01:09:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-53ec0194-7e96-421a-a845-202a1e3a630b tempest-AttachVolumeShelveTestJSON-1804839078 None] Lock "cinder-e6ee81bd-51d5-40c2-b085-967491b4016e-delete_volume" released by "delete_volume" :: held 7.245s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:09:43 devstack sudo[94545]: pam_unix(sudo:session): session closed for user root Jul 03 01:09:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a1ac000b-f1e2-47a9-85e3-07eb450aaa87 tempest-VolumesActionsTest-565573594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1" returned: 0 in 1.722s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:09:43 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-a1ac000b-f1e2-47a9-85e3-07eb450aaa87 tempest-VolumesActionsTest-565573594 None] Image conversion details: src /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1, size 1024.00 MB, duration 7.13 sec, destination /opt/stack/data/cinder/conversion/04d2744e-b97c-467e-ac18-acffce8e95d1.temp_image.18178a20-cdfb-4872-a2e2-f74901fd9a17h1kra4xy.img {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:09:43 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-a1ac000b-f1e2-47a9-85e3-07eb450aaa87 tempest-VolumesActionsTest-565573594 None] Converted 1024.00 MB image at 143.55 MB/s Jul 03 01:09:43 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-a1ac000b-f1e2-47a9-85e3-07eb450aaa87 tempest-VolumesActionsTest-565573594 None] 18178a20-cdfb-4872-a2e2-f74901fd9a17 was raw, no need to convert to raw {{(pid=86772) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 03 01:09:47 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:09:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Flow 'volume_create_manager' (8c03c793-f3c0-4c3c-a253-d91d0bd045f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:09:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b71052-839b-45a1-a1c5-ccf6afedb4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b71052-839b-45a1-a1c5-ccf6afedb4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1836716452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed332c17-c2bb-4bb8-b15f-df7543500e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19da7b3b9544646956efec48ee2fa33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:47Z,use_quota=True,user_id='2efa5fd750bc4f4faa1c5d4192e3ac71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d21990-bab6-4826-b778-fba5ee06710c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d21990-bab6-4826-b778-fba5ee06710c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5154fe5d-f4a2-42a4-9ea2-8676a2f03cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5154fe5d-f4a2-42a4-9ea2-8676a2f03cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed332c17-c2bb-4bb8-b15f-df7543500e0f', 'volume_name': 'volume-ed332c17-c2bb-4bb8-b15f-df7543500e0f', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b1de97-66e2-4aa7-b746-017b26abf11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b1de97-66e2-4aa7-b746-017b26abf11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:09:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8aa8c4a-f157-4b54-8830-21494ab53b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:09:47 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Volume ed332c17-c2bb-4bb8-b15f-df7543500e0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed332c17-c2bb-4bb8-b15f-df7543500e0f', 'volume_size': 1} Jul 03 01:09:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:09:57 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=8,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:09:57 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:10:07 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:10:07 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:10:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:10:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:12 devstack sudo[94746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:10:12 devstack sudo[94746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:13 devstack sudo[94746]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.818s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:10:13 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:10:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:10:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:10:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a1ac000b-f1e2-47a9-85e3-07eb450aaa87 tempest-VolumesActionsTest-565573594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 43.628s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a1ac000b-f1e2-47a9-85e3-07eb450aaa87 tempest-VolumesActionsTest-565573594 None] Uploaded volume to glance image-id: 18178a20-cdfb-4872-a2e2-f74901fd9a17. {{(pid=86772) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 03 01:10:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.142s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1836716452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed332c17-c2bb-4bb8-b15f-df7543500e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19da7b3b9544646956efec48ee2fa33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:09:47Z,use_quota=True,user_id='2efa5fd750bc4f4faa1c5d4192e3ac71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:10:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Creating volume ed332c17-c2bb-4bb8-b15f-df7543500e0f {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:10:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:10:15 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:10:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ed332c17-c2bb-4bb8-b15f-df7543500e0f 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:15 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a1ac000b-f1e2-47a9-85e3-07eb450aaa87 tempest-VolumesActionsTest-565573594 None] Copy volume to image completed successfully. Jul 03 01:10:15 devstack sudo[94755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ed332c17-c2bb-4bb8-b15f-df7543500e0f 1073741824 Jul 03 01:10:15 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:16 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:10:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Flow 'volume_create_manager' (7dd72af7-a3f6-45a1-a110-7c956b9423b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c31d36-d052-4720-883a-8dde574929c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c31d36-d052-4720-883a-8dde574929c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2004137622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09956263-c0fe-4504-935e-b60c3fc9ddeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b133f094add64e44ad5d3ccb72702669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:16Z,use_quota=True,user_id='a01d34fd8c344fc8bcb23ceb706c3b14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c934be7-3b09-46c3-9f47-5f8e6c0c8c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c934be7-3b09-46c3-9f47-5f8e6c0c8c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada0473a-c752-4e74-a08f-fe5bd496a699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada0473a-c752-4e74-a08f-fe5bd496a699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09956263-c0fe-4504-935e-b60c3fc9ddeb', 'volume_name': 'volume-09956263-c0fe-4504-935e-b60c3fc9ddeb', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3956e8-0e8d-42ed-bec4-0799695e0975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3956e8-0e8d-42ed-bec4-0799695e0975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac590cb-b37f-4b51-a69d-b6d3e79d45a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:16 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Volume 09956263-c0fe-4504-935e-b60c3fc9ddeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09956263-c0fe-4504-935e-b60c3fc9ddeb', 'volume_size': 1} Jul 03 01:10:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:16 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ed332c17-c2bb-4bb8-b15f-df7543500e0f 1073741824" returned: 0 in 1.071s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ed332c17-c2bb-4bb8-b15f-df7543500e0f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:16 devstack sudo[94763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ed332c17-c2bb-4bb8-b15f-df7543500e0f Jul 03 01:10:16 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:17 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ed332c17-c2bb-4bb8-b15f-df7543500e0f" returned: 0 in 0.644s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:10:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.844s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2004137622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09956263-c0fe-4504-935e-b60c3fc9ddeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b133f094add64e44ad5d3ccb72702669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:16Z,use_quota=True,user_id='a01d34fd8c344fc8bcb23ceb706c3b14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:10:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Creating volume 09956263-c0fe-4504-935e-b60c3fc9ddeb {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:10:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:10:17 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:10:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09956263-c0fe-4504-935e-b60c3fc9ddeb 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8aa8c4a-f157-4b54-8830-21494ab53b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed332c17-c2bb-4bb8-b15f-df7543500e0f', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf371e8-022e-437c-9b84-7519eb522fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:17 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09956263-c0fe-4504-935e-b60c3fc9ddeb 1073741824 Jul 03 01:10:17 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:17 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Volume volume-ed332c17-c2bb-4bb8-b15f-df7543500e0f (ed332c17-c2bb-4bb8-b15f-df7543500e0f): created successfully Jul 03 01:10:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf371e8-022e-437c-9b84-7519eb522fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Flow 'volume_create_manager' (8c03c793-f3c0-4c3c-a253-d91d0bd045f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:17 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f6ebec89-ebb7-48d9-a5c1-826773bfce11 tempest-VolumesActionsTest-1490173328 None] Created volume successfully. Jul 03 01:10:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4b035045-f5f5-4a27-8c87-6f7882479f94 tempest-VolumesActionsTest-1490173328 None] Acquiring lock "cinder-ed332c17-c2bb-4bb8-b15f-df7543500e0f" by "attach_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4b035045-f5f5-4a27-8c87-6f7882479f94 tempest-VolumesActionsTest-1490173328 None] Lock "cinder-ed332c17-c2bb-4bb8-b15f-df7543500e0f" acquired by "attach_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:18 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4b035045-f5f5-4a27-8c87-6f7882479f94 tempest-VolumesActionsTest-1490173328 None] Attaching volume ed332c17-c2bb-4bb8-b15f-df7543500e0f to instance d1ff5a68-4b42-465e-b469-ab3a6212fd88 at mountpoint /dev/vdb on host None. Jul 03 01:10:18 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4b035045-f5f5-4a27-8c87-6f7882479f94 tempest-VolumesActionsTest-1490173328 None] Attach volume completed successfully. Jul 03 01:10:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4b035045-f5f5-4a27-8c87-6f7882479f94 tempest-VolumesActionsTest-1490173328 None] Lock "cinder-ed332c17-c2bb-4bb8-b15f-df7543500e0f" released by "attach_volume" :: held 0.096s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:18 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09956263-c0fe-4504-935e-b60c3fc9ddeb 1073741824" returned: 0 in 0.905s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09956263-c0fe-4504-935e-b60c3fc9ddeb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:18 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09956263-c0fe-4504-935e-b60c3fc9ddeb Jul 03 01:10:18 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:19 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09956263-c0fe-4504-935e-b60c3fc9ddeb" returned: 0 in 0.725s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:10:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.165s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:19 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d739c025-4b7e-4a09-92ff-a5717c05d4d9]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac590cb-b37f-4b51-a69d-b6d3e79d45a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09956263-c0fe-4504-935e-b60c3fc9ddeb', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af65bc9-2592-409f-ab19-4e9ba1ca0855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:19 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-32ce72db-c93f-4af3-b305-ab887bcbce44 tempest-VolumesActionsTest-766529685 None] Terminate volume connection completed successfully. Jul 03 01:10:19 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Volume volume-09956263-c0fe-4504-935e-b60c3fc9ddeb (09956263-c0fe-4504-935e-b60c3fc9ddeb): created successfully Jul 03 01:10:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af65bc9-2592-409f-ab19-4e9ba1ca0855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Flow 'volume_create_manager' (7dd72af7-a3f6-45a1-a110-7c956b9423b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:19 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-57279c15-ea74-49b5-a9cd-59fee118065e tempest-AttachVolumeNegativeTest-1857772135 None] Created volume successfully. Jul 03 01:10:19 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 Jul 03 01:10:19 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-32ce72db-c93f-4af3-b305-ab887bcbce44 tempest-VolumesActionsTest-766529685 None] Acquiring lock "cinder-ed332c17-c2bb-4bb8-b15f-df7543500e0f-detach_volume" by "detach_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-32ce72db-c93f-4af3-b305-ab887bcbce44 tempest-VolumesActionsTest-766529685 None] Lock "cinder-ed332c17-c2bb-4bb8-b15f-df7543500e0f-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:19 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-32ce72db-c93f-4af3-b305-ab887bcbce44 tempest-VolumesActionsTest-766529685 None] Detaching volume ed332c17-c2bb-4bb8-b15f-df7543500e0f from instance d1ff5a68-4b42-465e-b469-ab3a6212fd88. Jul 03 01:10:19 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-32ce72db-c93f-4af3-b305-ab887bcbce44 tempest-VolumesActionsTest-766529685 None] Detach volume completed successfully. Jul 03 01:10:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-32ce72db-c93f-4af3-b305-ab887bcbce44 tempest-VolumesActionsTest-766529685 None] Lock "cinder-ed332c17-c2bb-4bb8-b15f-df7543500e0f-detach_volume" released by "detach_volume" :: held 0.082s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:20 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1" returned: 0 in 0.826s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:20 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[93569a09-90ec-4a83-a5e5-b98f11a72c78]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:20 devstack sudo[94784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 Jul 03 01:10:20 devstack sudo[94784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ba538fb2-3d30-48a8-bf2a-b1626a2e0513 tempest-VolumesActionsTest-1490173328 None] Acquiring lock "cinder-ed332c17-c2bb-4bb8-b15f-df7543500e0f-detach_volume" by "detach_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ba538fb2-3d30-48a8-bf2a-b1626a2e0513 tempest-VolumesActionsTest-1490173328 None] Lock "cinder-ed332c17-c2bb-4bb8-b15f-df7543500e0f-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:20 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ba538fb2-3d30-48a8-bf2a-b1626a2e0513 tempest-VolumesActionsTest-1490173328 None] Volume detach called, but volume not attached. Jul 03 01:10:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ba538fb2-3d30-48a8-bf2a-b1626a2e0513 tempest-VolumesActionsTest-1490173328 None] Lock "cinder-ed332c17-c2bb-4bb8-b15f-df7543500e0f-detach_volume" released by "detach_volume" :: held 0.031s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:21 devstack sudo[94784]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1" returned: 0 in 1.013s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 /opt/stack/data/cinder/conversion/04d2744e-b97c-467e-ac18-acffce8e95d1.temp_image.e5ee45b4-086f-489f-86b6-bc285124e4ae04nx8p6i.img {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:21 devstack sudo[94789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 /opt/stack/data/cinder/conversion/04d2744e-b97c-467e-ac18-acffce8e95d1.temp_image.e5ee45b4-086f-489f-86b6-bc285124e4ae04nx8p6i.img Jul 03 01:10:21 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6027fa05-90c5-4fbd-8247-5cc27e032804 tempest-VolumesActionsTest-1490173328 None] Acquiring lock "cinder-ed332c17-c2bb-4bb8-b15f-df7543500e0f-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6027fa05-90c5-4fbd-8247-5cc27e032804 tempest-VolumesActionsTest-1490173328 None] Lock "cinder-ed332c17-c2bb-4bb8-b15f-df7543500e0f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6027fa05-90c5-4fbd-8247-5cc27e032804 tempest-VolumesActionsTest-1490173328 None] Acquiring lock "cinder-quobyte-ed332c17-c2bb-4bb8-b15f-df7543500e0f" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6027fa05-90c5-4fbd-8247-5cc27e032804 tempest-VolumesActionsTest-1490173328 None] Lock "cinder-quobyte-ed332c17-c2bb-4bb8-b15f-df7543500e0f" acquired by "delete_volume" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:21 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9692a32-9471-4b4b-a842-f7e26a955bb8]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6027fa05-90c5-4fbd-8247-5cc27e032804 tempest-VolumesActionsTest-1490173328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ed332c17-c2bb-4bb8-b15f-df7543500e0f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:21 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ed332c17-c2bb-4bb8-b15f-df7543500e0f Jul 03 01:10:21 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:23 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6027fa05-90c5-4fbd-8247-5cc27e032804 tempest-VolumesActionsTest-1490173328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ed332c17-c2bb-4bb8-b15f-df7543500e0f" returned: 0 in 1.923s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6027fa05-90c5-4fbd-8247-5cc27e032804 tempest-VolumesActionsTest-1490173328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ed332c17-c2bb-4bb8-b15f-df7543500e0f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:23 devstack sudo[94829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ed332c17-c2bb-4bb8-b15f-df7543500e0f Jul 03 01:10:23 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-5fc7fecc-84c1-4163-a1d8-a6757d29e556 req-31f648c7-cfa3-415d-a50e-7d765f7bfa1b tempest-AttachVolumeNegativeTest-1857772135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:25 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6027fa05-90c5-4fbd-8247-5cc27e032804 tempest-VolumesActionsTest-1490173328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ed332c17-c2bb-4bb8-b15f-df7543500e0f" returned: 0 in 2.178s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6027fa05-90c5-4fbd-8247-5cc27e032804 tempest-VolumesActionsTest-1490173328 None] Lock "cinder-quobyte-ed332c17-c2bb-4bb8-b15f-df7543500e0f" released by "delete_volume" :: held 4.207s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:25 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-6027fa05-90c5-4fbd-8247-5cc27e032804 tempest-VolumesActionsTest-1490173328 None] Created reservations ['a941878e-7abb-48b1-b1c7-43493845a235', 'a8ecc35c-5d42-47e2-99ba-b641131ba859', '004b8118-2a09-4bfc-98f1-25f760af718e', '9311c2a7-8eba-4350-899d-b06c6578c40b'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:10:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6027fa05-90c5-4fbd-8247-5cc27e032804 tempest-VolumesActionsTest-1490173328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6027fa05-90c5-4fbd-8247-5cc27e032804 tempest-VolumesActionsTest-1490173328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6027fa05-90c5-4fbd-8247-5cc27e032804 tempest-VolumesActionsTest-1490173328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6027fa05-90c5-4fbd-8247-5cc27e032804 tempest-VolumesActionsTest-1490173328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6027fa05-90c5-4fbd-8247-5cc27e032804 tempest-VolumesActionsTest-1490173328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6027fa05-90c5-4fbd-8247-5cc27e032804 tempest-VolumesActionsTest-1490173328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:25 devstack sudo[94844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:10:25 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:27 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 /opt/stack/data/cinder/conversion/04d2744e-b97c-467e-ac18-acffce8e95d1.temp_image.e5ee45b4-086f-489f-86b6-bc285124e4ae04nx8p6i.img" returned: 0 in 6.299s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:27 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef00fa5-4588-41c0-9d2e-5566f81fac2f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:27 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6027fa05-90c5-4fbd-8247-5cc27e032804 tempest-VolumesActionsTest-1490173328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.728s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:27 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-6027fa05-90c5-4fbd-8247-5cc27e032804 tempest-VolumesActionsTest-1490173328 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:10:27 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 Jul 03 01:10:27 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:27 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6027fa05-90c5-4fbd-8247-5cc27e032804 tempest-VolumesActionsTest-1490173328 None] Deleted volume successfully. Jul 03 01:10:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6027fa05-90c5-4fbd-8247-5cc27e032804 tempest-VolumesActionsTest-1490173328 None] Lock "cinder-ed332c17-c2bb-4bb8-b15f-df7543500e0f-delete_volume" released by "delete_volume" :: held 6.428s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:28 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1" returned: 0 in 1.449s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:28 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] Image conversion details: src /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1, size 1024.00 MB, duration 6.30 sec, destination /opt/stack/data/cinder/conversion/04d2744e-b97c-467e-ac18-acffce8e95d1.temp_image.e5ee45b4-086f-489f-86b6-bc285124e4ae04nx8p6i.img {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:10:28 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] Converted 1024.00 MB image at 162.50 MB/s Jul 03 01:10:28 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] e5ee45b4-086f-489f-86b6-bc285124e4ae was raw, converting to qcow2 {{(pid=86772) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 03 01:10:28 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[33165fc3-c13b-45fa-a302-9f3065da1be3]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/04d2744e-b97c-467e-ac18-acffce8e95d1.temp_image.e5ee45b4-086f-489f-86b6-bc285124e4ae04nx8p6i.img {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:29 devstack sudo[94966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/04d2744e-b97c-467e-ac18-acffce8e95d1.temp_image.e5ee45b4-086f-489f-86b6-bc285124e4ae04nx8p6i.img Jul 03 01:10:29 devstack sudo[94966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:30 devstack sudo[94966]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/04d2744e-b97c-467e-ac18-acffce8e95d1.temp_image.e5ee45b4-086f-489f-86b6-bc285124e4ae04nx8p6i.img" returned: 0 in 1.152s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/04d2744e-b97c-467e-ac18-acffce8e95d1.temp_image.e5ee45b4-086f-489f-86b6-bc285124e4ae04nx8p6i.img {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:30 devstack sudo[94982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/04d2744e-b97c-467e-ac18-acffce8e95d1.temp_image.e5ee45b4-086f-489f-86b6-bc285124e4ae04nx8p6i.img Jul 03 01:10:30 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:30 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/04d2744e-b97c-467e-ac18-acffce8e95d1.temp_image.e5ee45b4-086f-489f-86b6-bc285124e4ae04nx8p6i.img" returned: 1 in 0.758s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/04d2744e-b97c-467e-ac18-acffce8e95d1.temp_image.e5ee45b4-086f-489f-86b6-bc285124e4ae04nx8p6i.img' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:10:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/04d2744e-b97c-467e-ac18-acffce8e95d1.temp_image.e5ee45b4-086f-489f-86b6-bc285124e4ae04nx8p6i.img /opt/stack/data/cinder/conversion/vol_upload_d84bx05e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:30 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/04d2744e-b97c-467e-ac18-acffce8e95d1.temp_image.e5ee45b4-086f-489f-86b6-bc285124e4ae04nx8p6i.img /opt/stack/data/cinder/conversion/vol_upload_d84bx05e Jul 03 01:10:30 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:31 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/04d2744e-b97c-467e-ac18-acffce8e95d1.temp_image.e5ee45b4-086f-489f-86b6-bc285124e4ae04nx8p6i.img /opt/stack/data/cinder/conversion/vol_upload_d84bx05e" returned: 0 in 0.698s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:31 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] Image conversion details: src /opt/stack/data/cinder/conversion/04d2744e-b97c-467e-ac18-acffce8e95d1.temp_image.e5ee45b4-086f-489f-86b6-bc285124e4ae04nx8p6i.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_d84bx05e {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:10:31 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 03 01:10:31 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edfb7dc-01c7-432b-b88b-01fd96cdd24b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_d84bx05e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:31 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_d84bx05e Jul 03 01:10:31 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:32 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_d84bx05e" returned: 0 in 0.927s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:34 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:10:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Flow 'volume_create_manager' (926bf208-f161-4ad1-a5df-7fa84325a4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4cddffd-30ea-44c9-89c4-cf0938c574d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4cddffd-30ea-44c9-89c4-cf0938c574d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1768954847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa179abf-f92d-4138-9f1a-8d447237870c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19da7b3b9544646956efec48ee2fa33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:34Z,use_quota=True,user_id='2efa5fd750bc4f4faa1c5d4192e3ac71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99a752a-d8c4-4e73-98c4-19490d24779d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99a752a-d8c4-4e73-98c4-19490d24779d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb18fa1c-d0af-43b9-8905-356c2fecd2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb18fa1c-d0af-43b9-8905-356c2fecd2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa179abf-f92d-4138-9f1a-8d447237870c', 'volume_name': 'volume-fa179abf-f92d-4138-9f1a-8d447237870c', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (998785f9-dc33-4ff3-b860-cad6f6355564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (998785f9-dc33-4ff3-b860-cad6f6355564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36482e56-05ce-40fe-8f93-10c36ccba22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:34 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Volume fa179abf-f92d-4138-9f1a-8d447237870c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa179abf-f92d-4138-9f1a-8d447237870c', 'volume_size': 1} Jul 03 01:10:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.235s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] Uploaded volume to glance image-id: e5ee45b4-086f-489f-86b6-bc285124e4ae. {{(pid=86772) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 03 01:10:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-5fc7fecc-84c1-4163-a1d8-a6757d29e556 req-31f648c7-cfa3-415d-a50e-7d765f7bfa1b tempest-AttachVolumeNegativeTest-1857772135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.496s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:34 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af5ac11-9648-4b8e-9d0f-f0dcbbc8c3c4]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-5fc7fecc-84c1-4163-a1d8-a6757d29e556 req-31f648c7-cfa3-415d-a50e-7d765f7bfa1b tempest-AttachVolumeNegativeTest-1857772135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09956263-c0fe-4504-935e-b60c3fc9ddeb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:34 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ef1e17c8-8300-4792-b89c-b08bf39b3220 tempest-VolumesActionsTest-565573594 None] Copy volume to image completed successfully. Jul 03 01:10:34 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09956263-c0fe-4504-935e-b60c3fc9ddeb Jul 03 01:10:34 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:35 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-5fc7fecc-84c1-4163-a1d8-a6757d29e556 req-31f648c7-cfa3-415d-a50e-7d765f7bfa1b tempest-AttachVolumeNegativeTest-1857772135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09956263-c0fe-4504-935e-b60c3fc9ddeb" returned: 0 in 0.835s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-5fc7fecc-84c1-4163-a1d8-a6757d29e556 req-31f648c7-cfa3-415d-a50e-7d765f7bfa1b tempest-AttachVolumeNegativeTest-1857772135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.864s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.980s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1768954847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa179abf-f92d-4138-9f1a-8d447237870c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19da7b3b9544646956efec48ee2fa33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:34Z,use_quota=True,user_id='2efa5fd750bc4f4faa1c5d4192e3ac71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:10:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Creating volume fa179abf-f92d-4138-9f1a-8d447237870c {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:10:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:10:35 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:10:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fa179abf-f92d-4138-9f1a-8d447237870c 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:35 devstack sudo[95008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fa179abf-f92d-4138-9f1a-8d447237870c 1073741824 Jul 03 01:10:35 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-5fc7fecc-84c1-4163-a1d8-a6757d29e556 req-31f648c7-cfa3-415d-a50e-7d765f7bfa1b tempest-AttachVolumeNegativeTest-1857772135 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171', 'name': 'volume-09956263-c0fe-4504-935e-b60c3fc9ddeb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16c4a91f-7b70-42ea-bdee-24432909bcc6', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:10:35 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-5fc7fecc-84c1-4163-a1d8-a6757d29e556 req-31f648c7-cfa3-415d-a50e-7d765f7bfa1b tempest-AttachVolumeNegativeTest-1857772135 None] attachment_update completed successfully. Jul 03 01:10:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-43c782ff-b306-4bc4-a113-8d84a39fe9e2 tempest-VolumesActionsTest-565573594 None] Acquiring lock "cinder-04d2744e-b97c-467e-ac18-acffce8e95d1-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-43c782ff-b306-4bc4-a113-8d84a39fe9e2 tempest-VolumesActionsTest-565573594 None] Lock "cinder-04d2744e-b97c-467e-ac18-acffce8e95d1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-43c782ff-b306-4bc4-a113-8d84a39fe9e2 tempest-VolumesActionsTest-565573594 None] Acquiring lock "cinder-quobyte-04d2744e-b97c-467e-ac18-acffce8e95d1" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-43c782ff-b306-4bc4-a113-8d84a39fe9e2 tempest-VolumesActionsTest-565573594 None] Lock "cinder-quobyte-04d2744e-b97c-467e-ac18-acffce8e95d1" acquired by "delete_volume" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:36 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d612ae-d279-48cc-82ef-9d908d104e10]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-43c782ff-b306-4bc4-a113-8d84a39fe9e2 tempest-VolumesActionsTest-565573594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:36 devstack sudo[95036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 Jul 03 01:10:36 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:36 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fa179abf-f92d-4138-9f1a-8d447237870c 1073741824" returned: 0 in 1.146s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fa179abf-f92d-4138-9f1a-8d447237870c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:36 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fa179abf-f92d-4138-9f1a-8d447237870c Jul 03 01:10:36 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:37 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-43c782ff-b306-4bc4-a113-8d84a39fe9e2 tempest-VolumesActionsTest-565573594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1" returned: 0 in 0.935s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-43c782ff-b306-4bc4-a113-8d84a39fe9e2 tempest-VolumesActionsTest-565573594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:37 devstack sudo[95404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1 Jul 03 01:10:37 devstack sudo[95404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:37 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fa179abf-f92d-4138-9f1a-8d447237870c" returned: 0 in 0.806s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:10:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36482e56-05ce-40fe-8f93-10c36ccba22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa179abf-f92d-4138-9f1a-8d447237870c', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827f42c9-e0ac-44da-9db6-0ecda6a0a812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:37 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Volume volume-fa179abf-f92d-4138-9f1a-8d447237870c (fa179abf-f92d-4138-9f1a-8d447237870c): created successfully Jul 03 01:10:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827f42c9-e0ac-44da-9db6-0ecda6a0a812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Flow 'volume_create_manager' (926bf208-f161-4ad1-a5df-7fa84325a4f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:37 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e50496ad-a70b-47ee-bc90-f679deb7563d tempest-VolumesActionsTest-1490173328 None] Created volume successfully. Jul 03 01:10:37 devstack sudo[95404]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-43c782ff-b306-4bc4-a113-8d84a39fe9e2 tempest-VolumesActionsTest-565573594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-04d2744e-b97c-467e-ac18-acffce8e95d1" returned: 0 in 0.760s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-43c782ff-b306-4bc4-a113-8d84a39fe9e2 tempest-VolumesActionsTest-565573594 None] Lock "cinder-quobyte-04d2744e-b97c-467e-ac18-acffce8e95d1" released by "delete_volume" :: held 1.745s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:37 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-43c782ff-b306-4bc4-a113-8d84a39fe9e2 tempest-VolumesActionsTest-565573594 None] Created reservations ['642eb12d-0eae-45c0-96c5-028b3cf103a0', '81e52236-a678-48ef-b0e3-5a4c6470fb42', '6bad1aca-ce6d-4782-b3b3-12b0c8f96e1b', '5453eb76-7ccf-4cec-bdaf-3070185f98ba'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:10:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-43c782ff-b306-4bc4-a113-8d84a39fe9e2 tempest-VolumesActionsTest-565573594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-43c782ff-b306-4bc4-a113-8d84a39fe9e2 tempest-VolumesActionsTest-565573594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-43c782ff-b306-4bc4-a113-8d84a39fe9e2 tempest-VolumesActionsTest-565573594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-43c782ff-b306-4bc4-a113-8d84a39fe9e2 tempest-VolumesActionsTest-565573594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-43c782ff-b306-4bc4-a113-8d84a39fe9e2 tempest-VolumesActionsTest-565573594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-43c782ff-b306-4bc4-a113-8d84a39fe9e2 tempest-VolumesActionsTest-565573594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:37 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:10:37 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-14ae7e4c-c340-41d6-9cd6-c2c7e01fe29d tempest-VolumesActionsTest-766529685 None] Acquiring lock "cinder-fa179abf-f92d-4138-9f1a-8d447237870c-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-14ae7e4c-c340-41d6-9cd6-c2c7e01fe29d tempest-VolumesActionsTest-766529685 None] Lock "cinder-fa179abf-f92d-4138-9f1a-8d447237870c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:38 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-43c782ff-b306-4bc4-a113-8d84a39fe9e2 tempest-VolumesActionsTest-565573594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.842s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:38 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-43c782ff-b306-4bc4-a113-8d84a39fe9e2 tempest-VolumesActionsTest-565573594 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:10:38 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-43c782ff-b306-4bc4-a113-8d84a39fe9e2 tempest-VolumesActionsTest-565573594 None] Deleted volume successfully. Jul 03 01:10:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-43c782ff-b306-4bc4-a113-8d84a39fe9e2 tempest-VolumesActionsTest-565573594 None] Lock "cinder-04d2744e-b97c-467e-ac18-acffce8e95d1-delete_volume" released by "delete_volume" :: held 2.888s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-14ae7e4c-c340-41d6-9cd6-c2c7e01fe29d tempest-VolumesActionsTest-766529685 None] Acquiring lock "cinder-quobyte-fa179abf-f92d-4138-9f1a-8d447237870c" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-14ae7e4c-c340-41d6-9cd6-c2c7e01fe29d tempest-VolumesActionsTest-766529685 None] Lock "cinder-quobyte-fa179abf-f92d-4138-9f1a-8d447237870c" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:38 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb683f3-339c-4163-a3b0-56a9763eb81f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-14ae7e4c-c340-41d6-9cd6-c2c7e01fe29d tempest-VolumesActionsTest-766529685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fa179abf-f92d-4138-9f1a-8d447237870c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:39 devstack sudo[95411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fa179abf-f92d-4138-9f1a-8d447237870c Jul 03 01:10:39 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:39 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-14ae7e4c-c340-41d6-9cd6-c2c7e01fe29d tempest-VolumesActionsTest-766529685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fa179abf-f92d-4138-9f1a-8d447237870c" returned: 0 in 0.953s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-14ae7e4c-c340-41d6-9cd6-c2c7e01fe29d tempest-VolumesActionsTest-766529685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fa179abf-f92d-4138-9f1a-8d447237870c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:39 devstack sudo[95416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fa179abf-f92d-4138-9f1a-8d447237870c Jul 03 01:10:39 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:40 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-14ae7e4c-c340-41d6-9cd6-c2c7e01fe29d tempest-VolumesActionsTest-766529685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fa179abf-f92d-4138-9f1a-8d447237870c" returned: 0 in 1.035s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-14ae7e4c-c340-41d6-9cd6-c2c7e01fe29d tempest-VolumesActionsTest-766529685 None] Lock "cinder-quobyte-fa179abf-f92d-4138-9f1a-8d447237870c" released by "delete_volume" :: held 2.045s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:41 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-14ae7e4c-c340-41d6-9cd6-c2c7e01fe29d tempest-VolumesActionsTest-766529685 None] Created reservations ['fb9d3653-1501-4a1a-86d7-8e827110e4a2', 'ac7f407d-d465-4ed2-a137-a920192f247d', 'd30e4610-f032-4461-92bc-0cddba43a605', '79d2dbbd-6498-47e6-9e1e-8f02d8c888e4'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:10:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-14ae7e4c-c340-41d6-9cd6-c2c7e01fe29d tempest-VolumesActionsTest-766529685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-14ae7e4c-c340-41d6-9cd6-c2c7e01fe29d tempest-VolumesActionsTest-766529685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-14ae7e4c-c340-41d6-9cd6-c2c7e01fe29d tempest-VolumesActionsTest-766529685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-14ae7e4c-c340-41d6-9cd6-c2c7e01fe29d tempest-VolumesActionsTest-766529685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-14ae7e4c-c340-41d6-9cd6-c2c7e01fe29d tempest-VolumesActionsTest-766529685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-14ae7e4c-c340-41d6-9cd6-c2c7e01fe29d tempest-VolumesActionsTest-766529685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:41 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:10:41 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:42 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-842cb70e-f70d-4c45-b556-a2c367428e1d req-e631589a-b4e1-4e91-a0c1-c3ba4cba7030 tempest-AttachVolumeNegativeTest-1857772135 None] Terminate volume connection completed successfully. Jul 03 01:10:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-842cb70e-f70d-4c45-b556-a2c367428e1d req-e631589a-b4e1-4e91-a0c1-c3ba4cba7030 tempest-AttachVolumeNegativeTest-1857772135 None] Deleting attachment 16c4a91f-7b70-42ea-bdee-24432909bcc6. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:10:42 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-14ae7e4c-c340-41d6-9cd6-c2c7e01fe29d tempest-VolumesActionsTest-766529685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.057s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:42 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-14ae7e4c-c340-41d6-9cd6-c2c7e01fe29d tempest-VolumesActionsTest-766529685 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:10:42 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-14ae7e4c-c340-41d6-9cd6-c2c7e01fe29d tempest-VolumesActionsTest-766529685 None] Deleted volume successfully. Jul 03 01:10:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-14ae7e4c-c340-41d6-9cd6-c2c7e01fe29d tempest-VolumesActionsTest-766529685 None] Lock "cinder-fa179abf-f92d-4138-9f1a-8d447237870c-delete_volume" released by "delete_volume" :: held 3.546s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:42 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:10:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Flow 'volume_create_manager' (b5df3c34-82ab-49f9-b178-de1b47114c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25c8493f-9482-4c03-861a-ec812080e387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25c8493f-9482-4c03-861a-ec812080e387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1818698033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19da7b3b9544646956efec48ee2fa33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:43Z,use_quota=True,user_id='2efa5fd750bc4f4faa1c5d4192e3ac71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99a8285c-5bfd-41ce-acdb-133ac8d038bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99a8285c-5bfd-41ce-acdb-133ac8d038bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c9ab0a-237f-4e6a-bf92-b5488c0e2430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c9ab0a-237f-4e6a-bf92-b5488c0e2430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1', 'volume_name': 'volume-cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d35af95-2c74-4b2d-ba5a-1121592ee9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d35af95-2c74-4b2d-ba5a-1121592ee9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6cbd83-55f7-4ba5-99af-473d10a1e90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:42 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Volume cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1', 'volume_size': 1} Jul 03 01:10:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1818698033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19da7b3b9544646956efec48ee2fa33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:43Z,use_quota=True,user_id='2efa5fd750bc4f4faa1c5d4192e3ac71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:10:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Creating volume cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:10:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:10:42 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:10:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:43 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1 1073741824 Jul 03 01:10:43 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:43 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1 1073741824" returned: 0 in 0.947s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:44 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1 Jul 03 01:10:44 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:44 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1" returned: 0 in 0.737s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:10:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6cbd83-55f7-4ba5-99af-473d10a1e90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7147b930-efd2-4f3d-80a0-8fd4dd7977d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:44 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Volume volume-cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1 (cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1): created successfully Jul 03 01:10:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7147b930-efd2-4f3d-80a0-8fd4dd7977d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Flow 'volume_create_manager' (b5df3c34-82ab-49f9-b178-de1b47114c85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:44 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-be04d551-d956-4a05-930e-b5a61fff1080 tempest-VolumesActionsTest-1490173328 None] Created volume successfully. Jul 03 01:10:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cce606fe-0417-4cfa-b30a-0321e4460e66 tempest-VolumesActionsTest-766529685 None] Acquiring lock "cinder-cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cce606fe-0417-4cfa-b30a-0321e4460e66 tempest-VolumesActionsTest-766529685 None] Lock "cinder-cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cce606fe-0417-4cfa-b30a-0321e4460e66 tempest-VolumesActionsTest-766529685 None] Acquiring lock "cinder-quobyte-cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cce606fe-0417-4cfa-b30a-0321e4460e66 tempest-VolumesActionsTest-766529685 None] Lock "cinder-quobyte-cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1" acquired by "delete_volume" :: waited 0.039s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:45 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[150c23ee-9ffe-4705-be2c-138bbc131c01]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cce606fe-0417-4cfa-b30a-0321e4460e66 tempest-VolumesActionsTest-766529685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:45 devstack sudo[95520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1 Jul 03 01:10:45 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:46 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:46 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:10:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Flow 'volume_create_manager' (ec9d60c1-c4e2-4588-b447-4380abfc53a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb3fcf4-e5d6-4d04-adae-d49f47ff6b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cce606fe-0417-4cfa-b30a-0321e4460e66 tempest-VolumesActionsTest-766529685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1" returned: 0 in 0.970s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cce606fe-0417-4cfa-b30a-0321e4460e66 tempest-VolumesActionsTest-766529685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:46 devstack sudo[95528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1 Jul 03 01:10:46 devstack sudo[95528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb3fcf4-e5d6-4d04-adae-d49f47ff6b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1838562033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=906a5734-9122-42b2-8bf0-796007e412fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f47b2406484d179bf8197b73498a38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:46Z,use_quota=True,user_id='1cc97757d8fe404089d8cf44dec2b1a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ada4798-d30c-48e8-8121-f8f7bac33762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ada4798-d30c-48e8-8121-f8f7bac33762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22f6223-82a7-4ad0-90d6-2156187f983b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22f6223-82a7-4ad0-90d6-2156187f983b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '906a5734-9122-42b2-8bf0-796007e412fd', 'volume_name': 'volume-906a5734-9122-42b2-8bf0-796007e412fd', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca722709-19dc-4cbf-9780-0fce3f2d75ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca722709-19dc-4cbf-9780-0fce3f2d75ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14727185-0eb9-404d-a3fd-b8a0eb66549f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:46 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Volume 906a5734-9122-42b2-8bf0-796007e412fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-906a5734-9122-42b2-8bf0-796007e412fd', 'volume_size': 1} Jul 03 01:10:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1838562033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=906a5734-9122-42b2-8bf0-796007e412fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f47b2406484d179bf8197b73498a38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:46Z,use_quota=True,user_id='1cc97757d8fe404089d8cf44dec2b1a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:10:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Creating volume 906a5734-9122-42b2-8bf0-796007e412fd {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:10:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:10:46 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:10:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:46 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd 1073741824 Jul 03 01:10:46 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:47 devstack sudo[95528]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cce606fe-0417-4cfa-b30a-0321e4460e66 tempest-VolumesActionsTest-766529685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1" returned: 0 in 0.717s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cce606fe-0417-4cfa-b30a-0321e4460e66 tempest-VolumesActionsTest-766529685 None] Lock "cinder-quobyte-cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1" released by "delete_volume" :: held 1.831s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:47 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-cce606fe-0417-4cfa-b30a-0321e4460e66 tempest-VolumesActionsTest-766529685 None] Created reservations ['a11c12fb-5bbd-42d0-8ee5-ef5ead83cb00', 'c2196cfc-c94c-4030-91f9-e0aad59184f2', '4ebe3c8b-2fa0-4142-a24c-c46a226a2fb7', '34c64331-6265-4880-b65f-d64526c7f3bd'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:10:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cce606fe-0417-4cfa-b30a-0321e4460e66 tempest-VolumesActionsTest-766529685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cce606fe-0417-4cfa-b30a-0321e4460e66 tempest-VolumesActionsTest-766529685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cce606fe-0417-4cfa-b30a-0321e4460e66 tempest-VolumesActionsTest-766529685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cce606fe-0417-4cfa-b30a-0321e4460e66 tempest-VolumesActionsTest-766529685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cce606fe-0417-4cfa-b30a-0321e4460e66 tempest-VolumesActionsTest-766529685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cce606fe-0417-4cfa-b30a-0321e4460e66 tempest-VolumesActionsTest-766529685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:47 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:10:47 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:47 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd 1073741824" returned: 0 in 1.176s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:47 devstack sudo[95541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd Jul 03 01:10:47 devstack sudo[95541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Flow 'volume_create_manager' (d4856fc7-96ec-4fb3-968f-16859b0e9b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6278f650-8a12-4d32-aa23-bc94831d946f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6278f650-8a12-4d32-aa23-bc94831d946f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1780363323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e10784-4379-47b9-b02b-9f10095dc15b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19da7b3b9544646956efec48ee2fa33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:48Z,use_quota=True,user_id='2efa5fd750bc4f4faa1c5d4192e3ac71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7deeccb-a23d-4862-81b7-f6941fb31ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7deeccb-a23d-4862-81b7-f6941fb31ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f9c8de-e76c-495e-a179-dc10f8df5f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f9c8de-e76c-495e-a179-dc10f8df5f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28e10784-4379-47b9-b02b-9f10095dc15b', 'volume_name': 'volume-28e10784-4379-47b9-b02b-9f10095dc15b', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0245c086-dd8d-409c-a73f-047b70a80357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0245c086-dd8d-409c-a73f-047b70a80357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1873c89-ede0-485a-b3b7-ccc90a999a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:48 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Volume 28e10784-4379-47b9-b02b-9f10095dc15b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28e10784-4379-47b9-b02b-9f10095dc15b', 'volume_size': 1} Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:48 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cce606fe-0417-4cfa-b30a-0321e4460e66 tempest-VolumesActionsTest-766529685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.925s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-cce606fe-0417-4cfa-b30a-0321e4460e66 tempest-VolumesActionsTest-766529685 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:10:48 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-cce606fe-0417-4cfa-b30a-0321e4460e66 tempest-VolumesActionsTest-766529685 None] Deleted volume successfully. Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cce606fe-0417-4cfa-b30a-0321e4460e66 tempest-VolumesActionsTest-766529685 None] Lock "cinder-cd9a15ea-ca5d-44dc-85ee-cc8c0dfa78b1-delete_volume" released by "delete_volume" :: held 3.166s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:48 devstack sudo[95541]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd" returned: 0 in 0.826s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] <== create_volume: return (2090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.093s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.340s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1780363323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e10784-4379-47b9-b02b-9f10095dc15b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19da7b3b9544646956efec48ee2fa33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:48Z,use_quota=True,user_id='2efa5fd750bc4f4faa1c5d4192e3ac71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Creating volume 28e10784-4379-47b9-b02b-9f10095dc15b {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:10:48 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-28e10784-4379-47b9-b02b-9f10095dc15b 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14727185-0eb9-404d-a3fd-b8a0eb66549f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-906a5734-9122-42b2-8bf0-796007e412fd', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:48 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-28e10784-4379-47b9-b02b-9f10095dc15b 1073741824 Jul 03 01:10:48 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be9c3b8-925a-427f-be69-a98173db61fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:48 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Volume volume-906a5734-9122-42b2-8bf0-796007e412fd (906a5734-9122-42b2-8bf0-796007e412fd): created successfully Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be9c3b8-925a-427f-be69-a98173db61fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Flow 'volume_create_manager' (ec9d60c1-c4e2-4588-b447-4380abfc53a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:48 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d171cb58-2317-4ebe-be29-b907bb9a24e1 tempest-VolumesCloneTest-1559869024 None] Created volume successfully. Jul 03 01:10:49 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-28e10784-4379-47b9-b02b-9f10095dc15b 1073741824" returned: 0 in 1.008s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-28e10784-4379-47b9-b02b-9f10095dc15b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:49 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-28e10784-4379-47b9-b02b-9f10095dc15b Jul 03 01:10:49 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:50 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:10:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Flow 'volume_create_manager' (7bdf29be-1e0f-457c-bfe5-73ef8c7ead08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb61ed6-bd9b-402e-a7f3-d2a8c696b67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb61ed6-bd9b-402e-a7f3-d2a8c696b67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-533589804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70655516-ae0e-4cee-ba12-91ff46a21f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f47b2406484d179bf8197b73498a38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=906a5734-9122-42b2-8bf0-796007e412fd,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:50Z,use_quota=True,user_id='1cc97757d8fe404089d8cf44dec2b1a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d9958a0-2794-4546-a1f2-08bf4217d511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d9958a0-2794-4546-a1f2-08bf4217d511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f6e405-b5c2-4b82-803d-6efa3b8b9e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f6e405-b5c2-4b82-803d-6efa3b8b9e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '70655516-ae0e-4cee-ba12-91ff46a21f4f', 'volume_name': 'volume-70655516-ae0e-4cee-ba12-91ff46a21f4f', 'volume_size': 2, 'source_volid': '906a5734-9122-42b2-8bf0-796007e412fd', 'source_volstatus': 'available'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c990d749-7d5e-452c-bdeb-aad2575c1712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c990d749-7d5e-452c-bdeb-aad2575c1712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dea12e9-2452-420b-9bf8-83ac75738f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:50 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Volume 70655516-ae0e-4cee-ba12-91ff46a21f4f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-70655516-ae0e-4cee-ba12-91ff46a21f4f', 'volume_size': 2, 'source_volid': '906a5734-9122-42b2-8bf0-796007e412fd', 'source_volstatus': 'available'} Jul 03 01:10:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:50 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-28e10784-4379-47b9-b02b-9f10095dc15b" returned: 0 in 0.744s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:10:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.126s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:50 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Cloning volume 906a5734-9122-42b2-8bf0-796007e412fd to volume 70655516-ae0e-4cee-ba12-91ff46a21f4f Jul 03 01:10:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1873c89-ede0-485a-b3b7-ccc90a999a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28e10784-4379-47b9-b02b-9f10095dc15b', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81041ae0-e159-49cc-8031-e5a510c3a607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:50 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Volume volume-28e10784-4379-47b9-b02b-9f10095dc15b (28e10784-4379-47b9-b02b-9f10095dc15b): created successfully Jul 03 01:10:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81041ae0-e159-49cc-8031-e5a510c3a607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Flow 'volume_create_manager' (d4856fc7-96ec-4fb3-968f-16859b0e9b1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Creating offline snapshot d4a9bf42-f193-440e-9340-eaaedf9ad4ef of volume 906a5734-9122-42b2-8bf0-796007e412fd {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:10:50 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-2a4c2e81-ea1c-4817-ba69-b493dab1f7d4 tempest-VolumesActionsTest-1490173328 None] Created volume successfully. Jul 03 01:10:50 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d63923-16ce-42c3-8392-6966913dafb6]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:50 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd Jul 03 01:10:50 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:51 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd" returned: 0 in 0.872s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.d4a9bf42-f193-440e-9340-eaaedf9ad4ef 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:51 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.d4a9bf42-f193-440e-9340-eaaedf9ad4ef 1G Jul 03 01:10:51 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f8326f70-91be-4131-91e4-15d98fbc4dee tempest-VolumesActionsTest-766529685 None] Acquiring lock "cinder-28e10784-4379-47b9-b02b-9f10095dc15b-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f8326f70-91be-4131-91e4-15d98fbc4dee tempest-VolumesActionsTest-766529685 None] Lock "cinder-28e10784-4379-47b9-b02b-9f10095dc15b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f8326f70-91be-4131-91e4-15d98fbc4dee tempest-VolumesActionsTest-766529685 None] Acquiring lock "cinder-quobyte-28e10784-4379-47b9-b02b-9f10095dc15b" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f8326f70-91be-4131-91e4-15d98fbc4dee tempest-VolumesActionsTest-766529685 None] Lock "cinder-quobyte-28e10784-4379-47b9-b02b-9f10095dc15b" acquired by "delete_volume" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:51 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f7b6c4-2b62-4b09-b647-42b0fc184d94]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8326f70-91be-4131-91e4-15d98fbc4dee tempest-VolumesActionsTest-766529685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-28e10784-4379-47b9-b02b-9f10095dc15b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:51 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-28e10784-4379-47b9-b02b-9f10095dc15b Jul 03 01:10:51 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:52 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.d4a9bf42-f193-440e-9340-eaaedf9ad4ef 1G" returned: 0 in 1.038s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-906a5734-9122-42b2-8bf0-796007e412fd -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.d4a9bf42-f193-440e-9340-eaaedf9ad4ef {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:52 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-906a5734-9122-42b2-8bf0-796007e412fd -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.d4a9bf42-f193-440e-9340-eaaedf9ad4ef Jul 03 01:10:52 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:52 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8326f70-91be-4131-91e4-15d98fbc4dee tempest-VolumesActionsTest-766529685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-28e10784-4379-47b9-b02b-9f10095dc15b" returned: 0 in 0.989s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8326f70-91be-4131-91e4-15d98fbc4dee tempest-VolumesActionsTest-766529685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-28e10784-4379-47b9-b02b-9f10095dc15b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:52 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-28e10784-4379-47b9-b02b-9f10095dc15b Jul 03 01:10:52 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-acf3fe7c-868a-448a-8f47-11aad924d881 tempest-AttachVolumeNegativeTest-1857772135 None] Acquiring lock "cinder-09956263-c0fe-4504-935e-b60c3fc9ddeb-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-acf3fe7c-868a-448a-8f47-11aad924d881 tempest-AttachVolumeNegativeTest-1857772135 None] Lock "cinder-09956263-c0fe-4504-935e-b60c3fc9ddeb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-acf3fe7c-868a-448a-8f47-11aad924d881 tempest-AttachVolumeNegativeTest-1857772135 None] Acquiring lock "cinder-quobyte-09956263-c0fe-4504-935e-b60c3fc9ddeb" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-acf3fe7c-868a-448a-8f47-11aad924d881 tempest-AttachVolumeNegativeTest-1857772135 None] Lock "cinder-quobyte-09956263-c0fe-4504-935e-b60c3fc9ddeb" acquired by "delete_volume" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:53 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8799a9-5315-4eb8-8e56-1739434a0e84]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-acf3fe7c-868a-448a-8f47-11aad924d881 tempest-AttachVolumeNegativeTest-1857772135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09956263-c0fe-4504-935e-b60c3fc9ddeb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:53 devstack sudo[95584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09956263-c0fe-4504-935e-b60c3fc9ddeb Jul 03 01:10:53 devstack sudo[95584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:53 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-906a5734-9122-42b2-8bf0-796007e412fd -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.d4a9bf42-f193-440e-9340-eaaedf9ad4ef" returned: 0 in 1.082s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:53 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.d4a9bf42-f193-440e-9340-eaaedf9ad4ef is being set with open permissions: ugo+rw Jul 03 01:10:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.d4a9bf42-f193-440e-9340-eaaedf9ad4ef {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:53 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.d4a9bf42-f193-440e-9340-eaaedf9ad4ef Jul 03 01:10:53 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:53 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8326f70-91be-4131-91e4-15d98fbc4dee tempest-VolumesActionsTest-766529685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-28e10784-4379-47b9-b02b-9f10095dc15b" returned: 0 in 1.034s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f8326f70-91be-4131-91e4-15d98fbc4dee tempest-VolumesActionsTest-766529685 None] Lock "cinder-quobyte-28e10784-4379-47b9-b02b-9f10095dc15b" released by "delete_volume" :: held 2.094s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:53 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:10:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Flow 'volume_create_manager' (188ab441-d3c9-4ee0-8be2-42da9d978877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66506ad1-a647-4d18-b2ee-d61dd2df2177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66506ad1-a647-4d18-b2ee-d61dd2df2177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1094206600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8297fbaf-eab3-4eee-a385-7140a29552dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb2837b837c46249c815ad7241aac9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:54Z,use_quota=True,user_id='9e8ca460308244ec8f9b71f440683ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0415eda6-c15b-4530-98df-0e4ea12f1dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0415eda6-c15b-4530-98df-0e4ea12f1dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a713550-a130-4aa7-b0e3-983cab8b7043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a713550-a130-4aa7-b0e3-983cab8b7043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8297fbaf-eab3-4eee-a385-7140a29552dc', 'volume_name': 'volume-8297fbaf-eab3-4eee-a385-7140a29552dc', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b00dd7c-ba05-4e95-85c8-6b047c229a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b00dd7c-ba05-4e95-85c8-6b047c229a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58fc16dd-2fe0-484f-b6b8-93a53c7774f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:53 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Volume 8297fbaf-eab3-4eee-a385-7140a29552dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8297fbaf-eab3-4eee-a385-7140a29552dc', 'volume_size': 1} Jul 03 01:10:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:53 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-f8326f70-91be-4131-91e4-15d98fbc4dee tempest-VolumesActionsTest-766529685 None] Created reservations ['709314fe-4f95-4aa8-bbfd-df296e76e933', '7b767cd2-2684-46c4-bc2c-1cf3bea25cee', '73b7201c-ea2c-4442-a4bb-03fa18e4f7d9', '37ff7610-b17f-4ec9-8ced-81cb68475d09'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:10:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f8326f70-91be-4131-91e4-15d98fbc4dee tempest-VolumesActionsTest-766529685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f8326f70-91be-4131-91e4-15d98fbc4dee tempest-VolumesActionsTest-766529685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f8326f70-91be-4131-91e4-15d98fbc4dee tempest-VolumesActionsTest-766529685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f8326f70-91be-4131-91e4-15d98fbc4dee tempest-VolumesActionsTest-766529685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f8326f70-91be-4131-91e4-15d98fbc4dee tempest-VolumesActionsTest-766529685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8326f70-91be-4131-91e4-15d98fbc4dee tempest-VolumesActionsTest-766529685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:54 devstack sudo[95590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:10:54 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:54 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:54 devstack sudo[95584]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-acf3fe7c-868a-448a-8f47-11aad924d881 tempest-AttachVolumeNegativeTest-1857772135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09956263-c0fe-4504-935e-b60c3fc9ddeb" returned: 0 in 1.085s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-acf3fe7c-868a-448a-8f47-11aad924d881 tempest-AttachVolumeNegativeTest-1857772135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09956263-c0fe-4504-935e-b60c3fc9ddeb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.d4a9bf42-f193-440e-9340-eaaedf9ad4ef" returned: 0 in 0.826s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:54 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09956263-c0fe-4504-935e-b60c3fc9ddeb Jul 03 01:10:54 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:54 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.info Jul 03 01:10:54 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:54 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8326f70-91be-4131-91e4-15d98fbc4dee tempest-VolumesActionsTest-766529685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.684s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:54 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-f8326f70-91be-4131-91e4-15d98fbc4dee tempest-VolumesActionsTest-766529685 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:10:54 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f8326f70-91be-4131-91e4-15d98fbc4dee tempest-VolumesActionsTest-766529685 None] Deleted volume successfully. Jul 03 01:10:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f8326f70-91be-4131-91e4-15d98fbc4dee tempest-VolumesActionsTest-766529685 None] Lock "cinder-28e10784-4379-47b9-b02b-9f10095dc15b-delete_volume" released by "delete_volume" :: held 3.155s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:55 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-acf3fe7c-868a-448a-8f47-11aad924d881 tempest-AttachVolumeNegativeTest-1857772135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09956263-c0fe-4504-935e-b60c3fc9ddeb" returned: 0 in 0.713s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-acf3fe7c-868a-448a-8f47-11aad924d881 tempest-AttachVolumeNegativeTest-1857772135 None] Lock "cinder-quobyte-09956263-c0fe-4504-935e-b60c3fc9ddeb" released by "delete_volume" :: held 1.862s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-acf3fe7c-868a-448a-8f47-11aad924d881 tempest-AttachVolumeNegativeTest-1857772135 None] Created reservations ['3e342ccf-38f9-4476-974e-a928b1066d09', 'ba01dac5-efab-4f15-9311-3323bfc36f1d', '208e6834-b582-46fe-a757-c4e624a9b3aa', '5cb1ca70-9d41-4a0b-8469-14fd295242ca'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:10:55 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.info" returned: 0 in 0.764s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:55 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.info is being set with open permissions: ugo+rw Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:55 devstack sudo[95603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.info Jul 03 01:10:55 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-acf3fe7c-868a-448a-8f47-11aad924d881 tempest-AttachVolumeNegativeTest-1857772135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-acf3fe7c-868a-448a-8f47-11aad924d881 tempest-AttachVolumeNegativeTest-1857772135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-acf3fe7c-868a-448a-8f47-11aad924d881 tempest-AttachVolumeNegativeTest-1857772135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-acf3fe7c-868a-448a-8f47-11aad924d881 tempest-AttachVolumeNegativeTest-1857772135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-acf3fe7c-868a-448a-8f47-11aad924d881 tempest-AttachVolumeNegativeTest-1857772135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-acf3fe7c-868a-448a-8f47-11aad924d881 tempest-AttachVolumeNegativeTest-1857772135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:55 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:10:55 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-093e7fa1-dfa2-4923-bdf9-3f353b5f5182 tempest-AttachVolumeNegativeTest-1857772135 None] Acquiring lock "cinder-375b6927-a923-4695-ad2b-9f2651f8ee31-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-093e7fa1-dfa2-4923-bdf9-3f353b5f5182 tempest-AttachVolumeNegativeTest-1857772135 None] Lock "cinder-375b6927-a923-4695-ad2b-9f2651f8ee31-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Flow 'volume_create_manager' (66207643-0cf3-4cbc-bbf1-8e30fb5a574b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d7c682-8a93-4c13-a819-98cdaa007ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d7c682-8a93-4c13-a819-98cdaa007ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-531802844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=233d047f-9ec9-4409-839b-a5888c0bc4b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19da7b3b9544646956efec48ee2fa33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:56Z,use_quota=True,user_id='2efa5fd750bc4f4faa1c5d4192e3ac71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0a09b8-3389-4b55-a7dc-9b73f3fda178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0a09b8-3389-4b55-a7dc-9b73f3fda178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55ca9b8-6a80-47ee-8226-5dd3839b4d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55ca9b8-6a80-47ee-8226-5dd3839b4d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '233d047f-9ec9-4409-839b-a5888c0bc4b9', 'volume_name': 'volume-233d047f-9ec9-4409-839b-a5888c0bc4b9', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca79ac1d-3704-4bd3-8847-af546066da73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca79ac1d-3704-4bd3-8847-af546066da73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c7dfa9-e86e-4ee0-b519-9eb28426d963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:10:55 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Volume 233d047f-9ec9-4409-839b-a5888c0bc4b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-233d047f-9ec9-4409-839b-a5888c0bc4b9', 'volume_size': 1} Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-093e7fa1-dfa2-4923-bdf9-3f353b5f5182 tempest-AttachVolumeNegativeTest-1857772135 None] Acquiring lock "cinder-quobyte-375b6927-a923-4695-ad2b-9f2651f8ee31" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-093e7fa1-dfa2-4923-bdf9-3f353b5f5182 tempest-AttachVolumeNegativeTest-1857772135 None] Lock "cinder-quobyte-375b6927-a923-4695-ad2b-9f2651f8ee31" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea752e1a-6e30-46e2-95c9-8ac5d28322c2]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-093e7fa1-dfa2-4923-bdf9-3f353b5f5182 tempest-AttachVolumeNegativeTest-1857772135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-375b6927-a923-4695-ad2b-9f2651f8ee31 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:55 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.info" returned: 0 in 0.769s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Acquiring lock "cinder-quobyte-70655516-ae0e-4cee-ba12-91ff46a21f4f" by "_copy_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:56 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-375b6927-a923-4695-ad2b-9f2651f8ee31 Jul 03 01:10:56 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Lock "cinder-quobyte-70655516-ae0e-4cee-ba12-91ff46a21f4f" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] snapshot: d4a9bf42-f193-440e-9340-eaaedf9ad4ef, volume: 70655516-ae0e-4cee-ba12-91ff46a21f4f, {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 01:10:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:56 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0696e4ff-34cc-4989-9d12-a5ec232d8178]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.d4a9bf42-f193-440e-9340-eaaedf9ad4ef {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:56 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-acf3fe7c-868a-448a-8f47-11aad924d881 tempest-AttachVolumeNegativeTest-1857772135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.871s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:56 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-acf3fe7c-868a-448a-8f47-11aad924d881 tempest-AttachVolumeNegativeTest-1857772135 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:10:56 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.d4a9bf42-f193-440e-9340-eaaedf9ad4ef Jul 03 01:10:56 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-acf3fe7c-868a-448a-8f47-11aad924d881 tempest-AttachVolumeNegativeTest-1857772135 None] Deleted volume successfully. Jul 03 01:10:56 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-acf3fe7c-868a-448a-8f47-11aad924d881 tempest-AttachVolumeNegativeTest-1857772135 None] Lock "cinder-09956263-c0fe-4504-935e-b60c3fc9ddeb-delete_volume" released by "delete_volume" :: held 3.054s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:56 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-093e7fa1-dfa2-4923-bdf9-3f353b5f5182 tempest-AttachVolumeNegativeTest-1857772135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-375b6927-a923-4695-ad2b-9f2651f8ee31" returned: 0 in 0.829s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-093e7fa1-dfa2-4923-bdf9-3f353b5f5182 tempest-AttachVolumeNegativeTest-1857772135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-375b6927-a923-4695-ad2b-9f2651f8ee31 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:56 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-375b6927-a923-4695-ad2b-9f2651f8ee31 Jul 03 01:10:56 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:57 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.d4a9bf42-f193-440e-9340-eaaedf9ad4ef" returned: 0 in 0.930s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-906a5734-9122-42b2-8bf0-796007e412fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:10:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 01:10:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Creating direct copy from snapshot {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 01:10:57 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be5c4d6-cd6a-4f90-983e-4c7f3639ce73]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:57 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd Jul 03 01:10:57 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:57 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-093e7fa1-dfa2-4923-bdf9-3f353b5f5182 tempest-AttachVolumeNegativeTest-1857772135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-375b6927-a923-4695-ad2b-9f2651f8ee31" returned: 0 in 0.764s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-093e7fa1-dfa2-4923-bdf9-3f353b5f5182 tempest-AttachVolumeNegativeTest-1857772135 None] Lock "cinder-quobyte-375b6927-a923-4695-ad2b-9f2651f8ee31" released by "delete_volume" :: held 1.641s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:57 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-093e7fa1-dfa2-4923-bdf9-3f353b5f5182 tempest-AttachVolumeNegativeTest-1857772135 None] Created reservations ['bbaa2fd4-22bf-4f9e-b46c-0f250697316f', '6f8bdc42-a2aa-469f-a4b9-a308f7889c61', '5479c1fa-4665-4180-a5f7-f33c782820e2', '153a0eb7-1640-40cc-b804-be07d3c32f00'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:10:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-093e7fa1-dfa2-4923-bdf9-3f353b5f5182 tempest-AttachVolumeNegativeTest-1857772135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:10:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-093e7fa1-dfa2-4923-bdf9-3f353b5f5182 tempest-AttachVolumeNegativeTest-1857772135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:10:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-093e7fa1-dfa2-4923-bdf9-3f353b5f5182 tempest-AttachVolumeNegativeTest-1857772135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:10:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-093e7fa1-dfa2-4923-bdf9-3f353b5f5182 tempest-AttachVolumeNegativeTest-1857772135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:10:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-093e7fa1-dfa2-4923-bdf9-3f353b5f5182 tempest-AttachVolumeNegativeTest-1857772135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:10:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-093e7fa1-dfa2-4923-bdf9-3f353b5f5182 tempest-AttachVolumeNegativeTest-1857772135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:57 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:10:57 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:57 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd" returned: 0 in 0.813s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:57 devstack cinder-volume[86772]: DEBUG cinder.utils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Path /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-70655516-ae0e-4cee-ba12-91ff46a21f4f not found in is_blk_device check {{(pid=86772) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 01:10:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-70655516-ae0e-4cee-ba12-91ff46a21f4f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:57 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-70655516-ae0e-4cee-ba12-91ff46a21f4f Jul 03 01:10:57 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7f9491dd-81ef-4307-a707-c3d9c6435470 tempest-AttachVolumeNegativeTest-1857772135 None] Acquiring lock "cinder-b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7f9491dd-81ef-4307-a707-c3d9c6435470 tempest-AttachVolumeNegativeTest-1857772135 None] Lock "cinder-b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7f9491dd-81ef-4307-a707-c3d9c6435470 tempest-AttachVolumeNegativeTest-1857772135 None] Acquiring lock "cinder-quobyte-b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:10:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7f9491dd-81ef-4307-a707-c3d9c6435470 tempest-AttachVolumeNegativeTest-1857772135 None] Lock "cinder-quobyte-b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4" acquired by "delete_volume" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:10:58 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f83024-f91c-49cc-b1b2-01d2e8a609a2]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:10:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7f9491dd-81ef-4307-a707-c3d9c6435470 tempest-AttachVolumeNegativeTest-1857772135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:10:58 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4 Jul 03 01:10:58 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:10:58 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-093e7fa1-dfa2-4923-bdf9-3f353b5f5182 tempest-AttachVolumeNegativeTest-1857772135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.792s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:58 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-093e7fa1-dfa2-4923-bdf9-3f353b5f5182 tempest-AttachVolumeNegativeTest-1857772135 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:10:58 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-093e7fa1-dfa2-4923-bdf9-3f353b5f5182 tempest-AttachVolumeNegativeTest-1857772135 None] Deleted volume successfully. Jul 03 01:10:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-093e7fa1-dfa2-4923-bdf9-3f353b5f5182 tempest-AttachVolumeNegativeTest-1857772135 None] Lock "cinder-375b6927-a923-4695-ad2b-9f2651f8ee31-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:10:59 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Jul 03 01:10:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7f9491dd-81ef-4307-a707-c3d9c6435470 tempest-AttachVolumeNegativeTest-1857772135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4" returned: 0 in 1.691s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:10:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7f9491dd-81ef-4307-a707-c3d9c6435470 tempest-AttachVolumeNegativeTest-1857772135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:00 devstack sudo[95656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4 Jul 03 01:11:00 devstack sudo[95656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:01 devstack sudo[95656]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7f9491dd-81ef-4307-a707-c3d9c6435470 tempest-AttachVolumeNegativeTest-1857772135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4" returned: 0 in 1.501s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7f9491dd-81ef-4307-a707-c3d9c6435470 tempest-AttachVolumeNegativeTest-1857772135 None] Lock "cinder-quobyte-b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4" released by "delete_volume" :: held 3.273s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:01 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-7f9491dd-81ef-4307-a707-c3d9c6435470 tempest-AttachVolumeNegativeTest-1857772135 None] Created reservations ['fdd9fe22-5e67-4971-875e-28d64e310717', '8dfe3ee8-0593-4ae1-b46a-2d05b6994bbf', 'ecd09f1b-5b6e-425c-b7d9-0af4a9324bfa', '9b96b2aa-8657-446a-950c-74b7385c896d'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:11:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7f9491dd-81ef-4307-a707-c3d9c6435470 tempest-AttachVolumeNegativeTest-1857772135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7f9491dd-81ef-4307-a707-c3d9c6435470 tempest-AttachVolumeNegativeTest-1857772135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7f9491dd-81ef-4307-a707-c3d9c6435470 tempest-AttachVolumeNegativeTest-1857772135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7f9491dd-81ef-4307-a707-c3d9c6435470 tempest-AttachVolumeNegativeTest-1857772135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7f9491dd-81ef-4307-a707-c3d9c6435470 tempest-AttachVolumeNegativeTest-1857772135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7f9491dd-81ef-4307-a707-c3d9c6435470 tempest-AttachVolumeNegativeTest-1857772135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:01 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:11:01 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:03 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7f9491dd-81ef-4307-a707-c3d9c6435470 tempest-AttachVolumeNegativeTest-1857772135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.329s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:03 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-7f9491dd-81ef-4307-a707-c3d9c6435470 tempest-AttachVolumeNegativeTest-1857772135 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:11:03 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7f9491dd-81ef-4307-a707-c3d9c6435470 tempest-AttachVolumeNegativeTest-1857772135 None] Deleted volume successfully. Jul 03 01:11:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7f9491dd-81ef-4307-a707-c3d9c6435470 tempest-AttachVolumeNegativeTest-1857772135 None] Lock "cinder-b2d1bf39-6d71-425b-8ab0-4edcdd8aa7b4-delete_volume" released by "delete_volume" :: held 5.092s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:03 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-70655516-ae0e-4cee-ba12-91ff46a21f4f" returned: 0 in 5.745s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:03 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76f9d03-1317-417b-a83f-eaf2df5c5c64]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:03 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd Jul 03 01:11:03 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:04 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd" returned: 0 in 1.028s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:04 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Image conversion details: src /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd, size 1024.00 MB, duration 5.75 sec, destination /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-70655516-ae0e-4cee-ba12-91ff46a21f4f {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:11:04 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Converted 1024.00 MB image at 178.21 MB/s Jul 03 01:11:04 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-70655516-ae0e-4cee-ba12-91ff46a21f4f is being set with open permissions: ugo+rw Jul 03 01:11:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-70655516-ae0e-4cee-ba12-91ff46a21f4f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:04 devstack sudo[95668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-70655516-ae0e-4cee-ba12-91ff46a21f4f Jul 03 01:11:04 devstack sudo[95668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:05 devstack sudo[95668]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-70655516-ae0e-4cee-ba12-91ff46a21f4f" returned: 0 in 0.695s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Lock "cinder-quobyte-70655516-ae0e-4cee-ba12-91ff46a21f4f" released by "_copy_volume_from_snapshot" :: held 9.310s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Acquiring lock "cinder-quobyte-d4a9bf42-f193-440e-9340-eaaedf9ad4ef" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Lock "cinder-quobyte-d4a9bf42-f193-440e-9340-eaaedf9ad4ef" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Deleting offline snapshot d4a9bf42-f193-440e-9340-eaaedf9ad4ef of volume 906a5734-9122-42b2-8bf0-796007e412fd {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:11:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] snapshot_file for this snap is: volume-906a5734-9122-42b2-8bf0-796007e412fd.d4a9bf42-f193-440e-9340-eaaedf9ad4ef {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:11:05 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e27d2c-dd7a-4a1f-951c-19bbbf086ae5]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.d4a9bf42-f193-440e-9340-eaaedf9ad4ef {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:05 devstack sudo[95671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.d4a9bf42-f193-440e-9340-eaaedf9ad4ef Jul 03 01:11:05 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:06 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.d4a9bf42-f193-440e-9340-eaaedf9ad4ef" returned: 0 in 0.852s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-906a5734-9122-42b2-8bf0-796007e412fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:11:06 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[734afeb9-03ce-48a8-9d7c-4a0d24206238]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:06 devstack sudo[95678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd Jul 03 01:11:06 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:07 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd" returned: 0 in 0.939s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.d4a9bf42-f193-440e-9340-eaaedf9ad4ef {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:07 devstack sudo[95718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.d4a9bf42-f193-440e-9340-eaaedf9ad4ef Jul 03 01:11:07 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:08 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.d4a9bf42-f193-440e-9340-eaaedf9ad4ef" returned: 0 in 0.956s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.d4a9bf42-f193-440e-9340-eaaedf9ad4ef {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:08 devstack sudo[95725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.d4a9bf42-f193-440e-9340-eaaedf9ad4ef Jul 03 01:11:08 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:09 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd.d4a9bf42-f193-440e-9340-eaaedf9ad4ef" returned: 0 in 0.787s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Lock "cinder-quobyte-d4a9bf42-f193-440e-9340-eaaedf9ad4ef" released by "_delete_snapshot" :: held 3.696s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:09 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=77,cinder:UPDATE=82,cinder:INSERT=20,cinder:DELETE=9 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:11:09 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=70,cinder:UPDATE=100,cinder:INSERT=22,cinder:DELETE=5 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:11:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.659s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.162s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1094206600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8297fbaf-eab3-4eee-a385-7140a29552dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb2837b837c46249c815ad7241aac9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:54Z,use_quota=True,user_id='9e8ca460308244ec8f9b71f440683ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:11:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Creating volume 8297fbaf-eab3-4eee-a385-7140a29552dc {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:11:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:11:09 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:11:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8297fbaf-eab3-4eee-a385-7140a29552dc 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dea12e9-2452-420b-9bf8-83ac75738f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70655516-ae0e-4cee-ba12-91ff46a21f4f', 'volume_size': 2, 'source_volid': '906a5734-9122-42b2-8bf0-796007e412fd', 'source_volstatus': 'available'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb7a524-2219-4489-8245-0993b37a75c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:09 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8297fbaf-eab3-4eee-a385-7140a29552dc 1073741824 Jul 03 01:11:09 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:09 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Volume volume-70655516-ae0e-4cee-ba12-91ff46a21f4f (70655516-ae0e-4cee-ba12-91ff46a21f4f): created successfully Jul 03 01:11:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb7a524-2219-4489-8245-0993b37a75c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Flow 'volume_create_manager' (7bdf29be-1e0f-457c-bfe5-73ef8c7ead08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:09 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7fe6823e-5a07-4892-9374-8cf5a9849331 tempest-VolumesCloneTest-1559869024 None] Created volume successfully. Jul 03 01:11:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-946171f6-ac2d-403d-a81e-0ea172ac3efc tempest-VolumesCloneTest-1559869024 None] Acquiring lock "cinder-70655516-ae0e-4cee-ba12-91ff46a21f4f-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-946171f6-ac2d-403d-a81e-0ea172ac3efc tempest-VolumesCloneTest-1559869024 None] Lock "cinder-70655516-ae0e-4cee-ba12-91ff46a21f4f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-946171f6-ac2d-403d-a81e-0ea172ac3efc tempest-VolumesCloneTest-1559869024 None] Acquiring lock "cinder-quobyte-70655516-ae0e-4cee-ba12-91ff46a21f4f" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-946171f6-ac2d-403d-a81e-0ea172ac3efc tempest-VolumesCloneTest-1559869024 None] Lock "cinder-quobyte-70655516-ae0e-4cee-ba12-91ff46a21f4f" acquired by "delete_volume" :: waited 0.035s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:10 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ec1d5e-face-4082-8e96-eeaee08df4e1]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-946171f6-ac2d-403d-a81e-0ea172ac3efc tempest-VolumesCloneTest-1559869024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-70655516-ae0e-4cee-ba12-91ff46a21f4f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:10 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8297fbaf-eab3-4eee-a385-7140a29552dc 1073741824" returned: 0 in 1.101s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8297fbaf-eab3-4eee-a385-7140a29552dc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:10 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8297fbaf-eab3-4eee-a385-7140a29552dc Jul 03 01:11:10 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:10 devstack sudo[95737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-70655516-ae0e-4cee-ba12-91ff46a21f4f Jul 03 01:11:10 devstack sudo[95737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:11 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8297fbaf-eab3-4eee-a385-7140a29552dc" returned: 0 in 0.758s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] <== create_volume: return (1913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.250s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-531802844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=233d047f-9ec9-4409-839b-a5888c0bc4b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19da7b3b9544646956efec48ee2fa33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:10:56Z,use_quota=True,user_id='2efa5fd750bc4f4faa1c5d4192e3ac71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Creating volume 233d047f-9ec9-4409-839b-a5888c0bc4b9 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:11:11 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-233d047f-9ec9-4409-839b-a5888c0bc4b9 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58fc16dd-2fe0-484f-b6b8-93a53c7774f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8297fbaf-eab3-4eee-a385-7140a29552dc', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:11 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-233d047f-9ec9-4409-839b-a5888c0bc4b9 1073741824 Jul 03 01:11:11 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c182b66-d5ee-4fae-b9fd-783748ad8530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:11 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Volume volume-8297fbaf-eab3-4eee-a385-7140a29552dc (8297fbaf-eab3-4eee-a385-7140a29552dc): created successfully Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c182b66-d5ee-4fae-b9fd-783748ad8530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Flow 'volume_create_manager' (188ab441-d3c9-4ee0-8be2-42da9d978877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:11 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d513b2e4-2f78-4a1e-8e61-bb13e8e1b8e4 tempest-AttachVolumeTestJSON-1781287949 None] Created volume successfully. Jul 03 01:11:11 devstack sudo[95737]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-946171f6-ac2d-403d-a81e-0ea172ac3efc tempest-VolumesCloneTest-1559869024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-70655516-ae0e-4cee-ba12-91ff46a21f4f" returned: 0 in 0.948s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-946171f6-ac2d-403d-a81e-0ea172ac3efc tempest-VolumesCloneTest-1559869024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-70655516-ae0e-4cee-ba12-91ff46a21f4f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:11 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-70655516-ae0e-4cee-ba12-91ff46a21f4f Jul 03 01:11:11 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Flow 'volume_create_manager' (e4fcbc84-3dff-4ead-9439-26f7e2ff04de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51745969-598c-4d75-b5af-ca3f95262aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51745969-598c-4d75-b5af-ca3f95262aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-333709133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a566fd97-f199-4eb4-8421-9cbb6d928826,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e71074d5bfc143ed90877e12f9880dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:12Z,use_quota=True,user_id='99cf306a946149578322df56360e7b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20736291-3553-4d38-99c2-de89dcf30008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20736291-3553-4d38-99c2-de89dcf30008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d4da7f-2898-46fb-b219-bc9f75459cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d4da7f-2898-46fb-b219-bc9f75459cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a566fd97-f199-4eb4-8421-9cbb6d928826', 'volume_name': 'volume-a566fd97-f199-4eb4-8421-9cbb6d928826', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374c9f9e-6464-48db-8784-bb50be0f3fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374c9f9e-6464-48db-8784-bb50be0f3fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:11 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae452a5b-eb15-4b30-9cba-abebee7dbb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:11 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Volume a566fd97-f199-4eb4-8421-9cbb6d928826: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a566fd97-f199-4eb4-8421-9cbb6d928826', 'volume_size': 1} Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-946171f6-ac2d-403d-a81e-0ea172ac3efc tempest-VolumesCloneTest-1559869024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-70655516-ae0e-4cee-ba12-91ff46a21f4f" returned: 0 in 0.810s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-946171f6-ac2d-403d-a81e-0ea172ac3efc tempest-VolumesCloneTest-1559869024 None] Lock "cinder-quobyte-70655516-ae0e-4cee-ba12-91ff46a21f4f" released by "delete_volume" :: held 1.831s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:12 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-946171f6-ac2d-403d-a81e-0ea172ac3efc tempest-VolumesCloneTest-1559869024 None] Created reservations ['87e8b234-df13-4e1d-a95e-54bb21e0859b', 'a9412819-048c-460b-bf63-ca889061336d', '2a00386c-aba2-4775-b552-8836cf264e2e', '736a8fc1-df24-40c7-95da-11602e8f3055'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:11:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-946171f6-ac2d-403d-a81e-0ea172ac3efc tempest-VolumesCloneTest-1559869024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-946171f6-ac2d-403d-a81e-0ea172ac3efc tempest-VolumesCloneTest-1559869024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-946171f6-ac2d-403d-a81e-0ea172ac3efc tempest-VolumesCloneTest-1559869024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-946171f6-ac2d-403d-a81e-0ea172ac3efc tempest-VolumesCloneTest-1559869024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-946171f6-ac2d-403d-a81e-0ea172ac3efc tempest-VolumesCloneTest-1559869024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-946171f6-ac2d-403d-a81e-0ea172ac3efc tempest-VolumesCloneTest-1559869024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:12 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:11:12 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:12 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-233d047f-9ec9-4409-839b-a5888c0bc4b9 1073741824" returned: 0 in 1.103s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-233d047f-9ec9-4409-839b-a5888c0bc4b9 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:12 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-233d047f-9ec9-4409-839b-a5888c0bc4b9 Jul 03 01:11:12 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-df760658-e978-4b86-8fac-913434f40bae tempest-VolumesCloneTest-1559869024 None] Acquiring lock "cinder-906a5734-9122-42b2-8bf0-796007e412fd-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-df760658-e978-4b86-8fac-913434f40bae tempest-VolumesCloneTest-1559869024 None] Lock "cinder-906a5734-9122-42b2-8bf0-796007e412fd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-df760658-e978-4b86-8fac-913434f40bae tempest-VolumesCloneTest-1559869024 None] Acquiring lock "cinder-quobyte-906a5734-9122-42b2-8bf0-796007e412fd" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-df760658-e978-4b86-8fac-913434f40bae tempest-VolumesCloneTest-1559869024 None] Lock "cinder-quobyte-906a5734-9122-42b2-8bf0-796007e412fd" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:12 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf51c7fa-2461-4421-821d-f696b53e4c2e]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-df760658-e978-4b86-8fac-913434f40bae tempest-VolumesCloneTest-1559869024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:12 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd Jul 03 01:11:12 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:12 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-946171f6-ac2d-403d-a81e-0ea172ac3efc tempest-VolumesCloneTest-1559869024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.683s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:12 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-946171f6-ac2d-403d-a81e-0ea172ac3efc tempest-VolumesCloneTest-1559869024 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:11:12 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-946171f6-ac2d-403d-a81e-0ea172ac3efc tempest-VolumesCloneTest-1559869024 None] Deleted volume successfully. Jul 03 01:11:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:11:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:12 devstack sudo[95768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:11:12 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-946171f6-ac2d-403d-a81e-0ea172ac3efc tempest-VolumesCloneTest-1559869024 None] Lock "cinder-70655516-ae0e-4cee-ba12-91ff46a21f4f-delete_volume" released by "delete_volume" :: held 2.819s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:13 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-233d047f-9ec9-4409-839b-a5888c0bc4b9" returned: 0 in 0.812s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] <== create_volume: return (1965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:11:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.051s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-333709133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a566fd97-f199-4eb4-8421-9cbb6d928826,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e71074d5bfc143ed90877e12f9880dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:12Z,use_quota=True,user_id='99cf306a946149578322df56360e7b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:11:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Creating volume a566fd97-f199-4eb4-8421-9cbb6d928826 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:11:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:11:13 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:11:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a566fd97-f199-4eb4-8421-9cbb6d928826 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:13 devstack sudo[95771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a566fd97-f199-4eb4-8421-9cbb6d928826 1073741824 Jul 03 01:11:13 devstack sudo[95771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c7dfa9-e86e-4ee0-b519-9eb28426d963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-233d047f-9ec9-4409-839b-a5888c0bc4b9', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e5350b-54bd-4427-b6f4-0c686c48d770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:13 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Volume volume-233d047f-9ec9-4409-839b-a5888c0bc4b9 (233d047f-9ec9-4409-839b-a5888c0bc4b9): created successfully Jul 03 01:11:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e5350b-54bd-4427-b6f4-0c686c48d770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Flow 'volume_create_manager' (66207643-0cf3-4cbc-bbf1-8e30fb5a574b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:13 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1f4d96e8-a331-4b18-9295-355a57abad30 tempest-VolumesActionsTest-1490173328 None] Created volume successfully. Jul 03 01:11:13 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-df760658-e978-4b86-8fac-913434f40bae tempest-VolumesCloneTest-1559869024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd" returned: 0 in 0.921s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-df760658-e978-4b86-8fac-913434f40bae tempest-VolumesCloneTest-1559869024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:13 devstack sudo[95779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd Jul 03 01:11:13 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:13 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.814s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:11:13 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:11:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:11:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:11:14 devstack sudo[95771]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a566fd97-f199-4eb4-8421-9cbb6d928826 1073741824" returned: 0 in 1.054s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a566fd97-f199-4eb4-8421-9cbb6d928826 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:14 devstack sudo[95787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a566fd97-f199-4eb4-8421-9cbb6d928826 Jul 03 01:11:14 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:14 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-df760658-e978-4b86-8fac-913434f40bae tempest-VolumesCloneTest-1559869024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-906a5734-9122-42b2-8bf0-796007e412fd" returned: 0 in 0.767s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-df760658-e978-4b86-8fac-913434f40bae tempest-VolumesCloneTest-1559869024 None] Lock "cinder-quobyte-906a5734-9122-42b2-8bf0-796007e412fd" released by "delete_volume" :: held 1.794s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:14 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-df760658-e978-4b86-8fac-913434f40bae tempest-VolumesCloneTest-1559869024 None] Created reservations ['ea1beaf8-b88d-4d4b-b7bc-7239d6dd0437', '09950af0-2508-4059-888f-653711d5952c', '06119aeb-5df2-4ea8-8631-ba81d055b1ad', '9464cfed-4dc4-4dc0-ac1b-c4512acbc22b'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:11:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-df760658-e978-4b86-8fac-913434f40bae tempest-VolumesCloneTest-1559869024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-df760658-e978-4b86-8fac-913434f40bae tempest-VolumesCloneTest-1559869024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-df760658-e978-4b86-8fac-913434f40bae tempest-VolumesCloneTest-1559869024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-df760658-e978-4b86-8fac-913434f40bae tempest-VolumesCloneTest-1559869024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-df760658-e978-4b86-8fac-913434f40bae tempest-VolumesCloneTest-1559869024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-df760658-e978-4b86-8fac-913434f40bae tempest-VolumesCloneTest-1559869024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:14 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:11:14 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9fad46f7-23b5-4ce7-9541-8a61e5bb932b tempest-VolumesActionsTest-766529685 None] Acquiring lock "cinder-233d047f-9ec9-4409-839b-a5888c0bc4b9-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9fad46f7-23b5-4ce7-9541-8a61e5bb932b tempest-VolumesActionsTest-766529685 None] Lock "cinder-233d047f-9ec9-4409-839b-a5888c0bc4b9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-6290e62b-1ffb-4016-9598-27ac9224d4dc req-8bbd611c-18da-4053-a5b4-38fe936a141d tempest-AttachVolumeTestJSON-1781287949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9fad46f7-23b5-4ce7-9541-8a61e5bb932b tempest-VolumesActionsTest-766529685 None] Acquiring lock "cinder-quobyte-233d047f-9ec9-4409-839b-a5888c0bc4b9" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9fad46f7-23b5-4ce7-9541-8a61e5bb932b tempest-VolumesActionsTest-766529685 None] Lock "cinder-quobyte-233d047f-9ec9-4409-839b-a5888c0bc4b9" acquired by "delete_volume" :: waited 0.013s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:14 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8261a9-cbd2-4f63-9fae-6eab87bfd7d0]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9fad46f7-23b5-4ce7-9541-8a61e5bb932b tempest-VolumesActionsTest-766529685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-233d047f-9ec9-4409-839b-a5888c0bc4b9 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:14 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-233d047f-9ec9-4409-839b-a5888c0bc4b9 Jul 03 01:11:14 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:14 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a566fd97-f199-4eb4-8421-9cbb6d928826" returned: 0 in 0.826s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] <== create_volume: return (1925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:11:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.930s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-6290e62b-1ffb-4016-9598-27ac9224d4dc req-8bbd611c-18da-4053-a5b4-38fe936a141d tempest-AttachVolumeTestJSON-1781287949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.264s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae452a5b-eb15-4b30-9cba-abebee7dbb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a566fd97-f199-4eb4-8421-9cbb6d928826', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adffcb98-8ea1-4afc-8417-82b98017d20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:15 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9ce4b7-a78d-42f7-9394-bb32f852c0f5]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-6290e62b-1ffb-4016-9598-27ac9224d4dc req-8bbd611c-18da-4053-a5b4-38fe936a141d tempest-AttachVolumeTestJSON-1781287949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8297fbaf-eab3-4eee-a385-7140a29552dc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:15 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Volume volume-a566fd97-f199-4eb4-8421-9cbb6d928826 (a566fd97-f199-4eb4-8421-9cbb6d928826): created successfully Jul 03 01:11:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adffcb98-8ea1-4afc-8417-82b98017d20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Flow 'volume_create_manager' (e4fcbc84-3dff-4ead-9439-26f7e2ff04de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:15 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6fd345c3-80c7-4ff9-89ff-6a2d5e82708b tempest-VolumesTestJSON-1685263663 None] Created volume successfully. Jul 03 01:11:15 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8297fbaf-eab3-4eee-a385-7140a29552dc Jul 03 01:11:15 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:15 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-df760658-e978-4b86-8fac-913434f40bae tempest-VolumesCloneTest-1559869024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.938s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:15 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-df760658-e978-4b86-8fac-913434f40bae tempest-VolumesCloneTest-1559869024 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:11:15 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-df760658-e978-4b86-8fac-913434f40bae tempest-VolumesCloneTest-1559869024 None] Deleted volume successfully. Jul 03 01:11:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-df760658-e978-4b86-8fac-913434f40bae tempest-VolumesCloneTest-1559869024 None] Lock "cinder-906a5734-9122-42b2-8bf0-796007e412fd-delete_volume" released by "delete_volume" :: held 3.016s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:15 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9fad46f7-23b5-4ce7-9541-8a61e5bb932b tempest-VolumesActionsTest-766529685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-233d047f-9ec9-4409-839b-a5888c0bc4b9" returned: 0 in 0.992s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9fad46f7-23b5-4ce7-9541-8a61e5bb932b tempest-VolumesActionsTest-766529685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-233d047f-9ec9-4409-839b-a5888c0bc4b9 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:15 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-233d047f-9ec9-4409-839b-a5888c0bc4b9 Jul 03 01:11:15 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:16 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-6290e62b-1ffb-4016-9598-27ac9224d4dc req-8bbd611c-18da-4053-a5b4-38fe936a141d tempest-AttachVolumeTestJSON-1781287949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8297fbaf-eab3-4eee-a385-7140a29552dc" returned: 0 in 0.993s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-6290e62b-1ffb-4016-9598-27ac9224d4dc req-8bbd611c-18da-4053-a5b4-38fe936a141d tempest-AttachVolumeTestJSON-1781287949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.047s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-6290e62b-1ffb-4016-9598-27ac9224d4dc req-8bbd611c-18da-4053-a5b4-38fe936a141d tempest-AttachVolumeTestJSON-1781287949 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171', 'name': 'volume-8297fbaf-eab3-4eee-a385-7140a29552dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'acddc171-8af5-4767-8c48-6e1da69dd63e', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:11:16 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-6290e62b-1ffb-4016-9598-27ac9224d4dc req-8bbd611c-18da-4053-a5b4-38fe936a141d tempest-AttachVolumeTestJSON-1781287949 None] attachment_update completed successfully. Jul 03 01:11:16 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9fad46f7-23b5-4ce7-9541-8a61e5bb932b tempest-VolumesActionsTest-766529685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-233d047f-9ec9-4409-839b-a5888c0bc4b9" returned: 0 in 0.876s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9fad46f7-23b5-4ce7-9541-8a61e5bb932b tempest-VolumesActionsTest-766529685 None] Lock "cinder-quobyte-233d047f-9ec9-4409-839b-a5888c0bc4b9" released by "delete_volume" :: held 1.951s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:16 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-9fad46f7-23b5-4ce7-9541-8a61e5bb932b tempest-VolumesActionsTest-766529685 None] Created reservations ['21995bb2-4279-4c87-a0e0-72c93b4416e6', '628e9079-9fb6-4624-be7a-68a1ad358363', '096ed8df-4d95-43a8-9140-f28bea5973e5', 'ecbe58df-f26e-4911-af92-2c4d4e7650c3'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:11:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9fad46f7-23b5-4ce7-9541-8a61e5bb932b tempest-VolumesActionsTest-766529685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9fad46f7-23b5-4ce7-9541-8a61e5bb932b tempest-VolumesActionsTest-766529685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9fad46f7-23b5-4ce7-9541-8a61e5bb932b tempest-VolumesActionsTest-766529685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9fad46f7-23b5-4ce7-9541-8a61e5bb932b tempest-VolumesActionsTest-766529685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9fad46f7-23b5-4ce7-9541-8a61e5bb932b tempest-VolumesActionsTest-766529685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9fad46f7-23b5-4ce7-9541-8a61e5bb932b tempest-VolumesActionsTest-766529685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:16 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:11:16 devstack sudo[95879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:11:16 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Flow 'volume_create_manager' (5e678910-0007-4d26-bb5b-421a145b0bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed3275a5-d57c-47a4-87d3-2b409b668ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed3275a5-d57c-47a4-87d3-2b409b668ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1476022086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d21bdd28-5d55-4ddf-958e-ee59a65d1bff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e71074d5bfc143ed90877e12f9880dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:17Z,use_quota=True,user_id='99cf306a946149578322df56360e7b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3076618-6aba-49b5-b9c3-1e2d7b7c9e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3076618-6aba-49b5-b9c3-1e2d7b7c9e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9574ed8-db4f-40b5-a1c7-4e1b90bcd670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9574ed8-db4f-40b5-a1c7-4e1b90bcd670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd21bdd28-5d55-4ddf-958e-ee59a65d1bff', 'volume_name': 'volume-d21bdd28-5d55-4ddf-958e-ee59a65d1bff', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04531680-6236-4e28-b997-429d166a0fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04531680-6236-4e28-b997-429d166a0fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d903cf51-0199-4004-8890-0a1ef77eeb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:17 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Volume d21bdd28-5d55-4ddf-958e-ee59a65d1bff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d21bdd28-5d55-4ddf-958e-ee59a65d1bff', 'volume_size': 1} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1476022086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d21bdd28-5d55-4ddf-958e-ee59a65d1bff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e71074d5bfc143ed90877e12f9880dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:17Z,use_quota=True,user_id='99cf306a946149578322df56360e7b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Creating volume d21bdd28-5d55-4ddf-958e-ee59a65d1bff {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:11:17 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d21bdd28-5d55-4ddf-958e-ee59a65d1bff 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:17 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d21bdd28-5d55-4ddf-958e-ee59a65d1bff 1073741824 Jul 03 01:11:17 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Flow 'volume_create_manager' (0116105a-3461-4d0f-ab23-983e5536bf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce60d0b-aec7-4f6c-b6c1-69480becd3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce60d0b-aec7-4f6c-b6c1-69480becd3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2106919090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7127e024-7a98-42e4-a0cf-aaefb05a62da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19da7b3b9544646956efec48ee2fa33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:18Z,use_quota=True,user_id='2efa5fd750bc4f4faa1c5d4192e3ac71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96a7b4ad-0ac6-438f-bb99-3bb5e7ebb66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:17 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96a7b4ad-0ac6-438f-bb99-3bb5e7ebb66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b087ab1d-4c97-47b4-8feb-37871fdb9ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b087ab1d-4c97-47b4-8feb-37871fdb9ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7127e024-7a98-42e4-a0cf-aaefb05a62da', 'volume_name': 'volume-7127e024-7a98-42e4-a0cf-aaefb05a62da', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e8e2c2f-c2b2-475e-b9b2-f2719e4d96c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e8e2c2f-c2b2-475e-b9b2-f2719e4d96c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49332d73-02a3-4f44-840f-02e7c61bbb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:17 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Volume 7127e024-7a98-42e4-a0cf-aaefb05a62da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7127e024-7a98-42e4-a0cf-aaefb05a62da', 'volume_size': 1} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9fad46f7-23b5-4ce7-9541-8a61e5bb932b tempest-VolumesActionsTest-766529685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.014s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-9fad46f7-23b5-4ce7-9541-8a61e5bb932b tempest-VolumesActionsTest-766529685 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:11:17 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9fad46f7-23b5-4ce7-9541-8a61e5bb932b tempest-VolumesActionsTest-766529685 None] Deleted volume successfully. Jul 03 01:11:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9fad46f7-23b5-4ce7-9541-8a61e5bb932b tempest-VolumesActionsTest-766529685 None] Lock "cinder-233d047f-9ec9-4409-839b-a5888c0bc4b9-delete_volume" released by "delete_volume" :: held 3.363s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:18 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d21bdd28-5d55-4ddf-958e-ee59a65d1bff 1073741824" returned: 0 in 1.149s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d21bdd28-5d55-4ddf-958e-ee59a65d1bff {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:18 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d21bdd28-5d55-4ddf-958e-ee59a65d1bff Jul 03 01:11:18 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:18 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:11:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Flow 'volume_create_manager' (93a0cb77-2bbe-4095-8cea-ed94ec7763f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (239722c0-052c-4601-9ef8-58e22964c2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (239722c0-052c-4601-9ef8-58e22964c2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-522408791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51fd1131-e2e1-4400-b771-e967f848fde7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c7bdaf3a37414bbca8e0187f4bcf5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:19Z,use_quota=True,user_id='e94ccef7249243e3800db8938438fb68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90959df-9d28-453b-87cb-00fb1542df34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90959df-9d28-453b-87cb-00fb1542df34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57bed5a-40c7-49dd-829e-8b8ff9833780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57bed5a-40c7-49dd-829e-8b8ff9833780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51fd1131-e2e1-4400-b771-e967f848fde7', 'volume_name': 'volume-51fd1131-e2e1-4400-b771-e967f848fde7', 'volume_size': 2}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c09f1c09-8e2b-4ec7-b673-f747b927d6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c09f1c09-8e2b-4ec7-b673-f747b927d6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb3d31fd-7e33-4bb3-8eb1-8ee1869543d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:18 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Volume 51fd1131-e2e1-4400-b771-e967f848fde7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51fd1131-e2e1-4400-b771-e967f848fde7', 'volume_size': 2} Jul 03 01:11:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:19 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d21bdd28-5d55-4ddf-958e-ee59a65d1bff" returned: 0 in 0.755s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:11:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.143s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2106919090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7127e024-7a98-42e4-a0cf-aaefb05a62da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19da7b3b9544646956efec48ee2fa33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:18Z,use_quota=True,user_id='2efa5fd750bc4f4faa1c5d4192e3ac71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:11:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Creating volume 7127e024-7a98-42e4-a0cf-aaefb05a62da {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:11:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:11:19 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:11:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7127e024-7a98-42e4-a0cf-aaefb05a62da 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d903cf51-0199-4004-8890-0a1ef77eeb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d21bdd28-5d55-4ddf-958e-ee59a65d1bff', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:19 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7127e024-7a98-42e4-a0cf-aaefb05a62da 1073741824 Jul 03 01:11:19 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3499534a-d9aa-41bc-a8c2-6c3580ccbd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:19 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Volume volume-d21bdd28-5d55-4ddf-958e-ee59a65d1bff (d21bdd28-5d55-4ddf-958e-ee59a65d1bff): created successfully Jul 03 01:11:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3499534a-d9aa-41bc-a8c2-6c3580ccbd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Flow 'volume_create_manager' (5e678910-0007-4d26-bb5b-421a145b0bfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:19 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-815bccc6-5b86-4100-9236-841290c4cad6 tempest-VolumesTestJSON-1685263663 None] Created volume successfully. Jul 03 01:11:19 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7127e024-7a98-42e4-a0cf-aaefb05a62da 1073741824" returned: 0 in 0.829s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7127e024-7a98-42e4-a0cf-aaefb05a62da {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:19 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7127e024-7a98-42e4-a0cf-aaefb05a62da Jul 03 01:11:19 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:20 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7127e024-7a98-42e4-a0cf-aaefb05a62da" returned: 0 in 0.651s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.898s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-522408791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51fd1131-e2e1-4400-b771-e967f848fde7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c7bdaf3a37414bbca8e0187f4bcf5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:19Z,use_quota=True,user_id='e94ccef7249243e3800db8938438fb68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Creating volume 51fd1131-e2e1-4400-b771-e967f848fde7 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:11:20 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-51fd1131-e2e1-4400-b771-e967f848fde7 2147483648 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:20 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-51fd1131-e2e1-4400-b771-e967f848fde7 2147483648 Jul 03 01:11:20 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49332d73-02a3-4f44-840f-02e7c61bbb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7127e024-7a98-42e4-a0cf-aaefb05a62da', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92fd6225-4a31-4b09-b301-7c18fb507e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:20 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Volume volume-7127e024-7a98-42e4-a0cf-aaefb05a62da (7127e024-7a98-42e4-a0cf-aaefb05a62da): created successfully Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92fd6225-4a31-4b09-b301-7c18fb507e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Flow 'volume_create_manager' (0116105a-3461-4d0f-ab23-983e5536bf24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Flow 'volume_create_manager' (2c8bc071-6132-47ae-b6fa-398953d6ceba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ea7365-0c54-444e-a5d9-75a0d71e8123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ea7365-0c54-444e-a5d9-75a0d71e8123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1018211739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09820ac4-2df4-4ba0-89de-9380aaacd278,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e71074d5bfc143ed90877e12f9880dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:21Z,use_quota=True,user_id='99cf306a946149578322df56360e7b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a933c4-2547-449e-bfb6-3998a599754f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a933c4-2547-449e-bfb6-3998a599754f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c11724-4369-49f8-b7f0-83043dadacc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c11724-4369-49f8-b7f0-83043dadacc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09820ac4-2df4-4ba0-89de-9380aaacd278', 'volume_name': 'volume-09820ac4-2df4-4ba0-89de-9380aaacd278', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c6afb4d-009d-4a90-90ea-8eef68932d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c6afb4d-009d-4a90-90ea-8eef68932d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb7e520c-a434-485c-b417-3373b6211dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:20 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Volume 09820ac4-2df4-4ba0-89de-9380aaacd278: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09820ac4-2df4-4ba0-89de-9380aaacd278', 'volume_size': 1} Jul 03 01:11:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:20 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8c868d90-bd97-480c-962d-c9a6508cb968 tempest-VolumesActionsTest-1490173328 None] Created volume successfully. Jul 03 01:11:21 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-51fd1131-e2e1-4400-b771-e967f848fde7 2147483648" returned: 0 in 0.993s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-51fd1131-e2e1-4400-b771-e967f848fde7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:21 devstack sudo[96228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-51fd1131-e2e1-4400-b771-e967f848fde7 Jul 03 01:11:21 devstack sudo[96228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:22 devstack sudo[96228]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-51fd1131-e2e1-4400-b771-e967f848fde7" returned: 0 in 0.700s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:11:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.542s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1018211739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09820ac4-2df4-4ba0-89de-9380aaacd278,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e71074d5bfc143ed90877e12f9880dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:21Z,use_quota=True,user_id='99cf306a946149578322df56360e7b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:11:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Creating volume 09820ac4-2df4-4ba0-89de-9380aaacd278 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:11:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:11:22 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:11:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09820ac4-2df4-4ba0-89de-9380aaacd278 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb3d31fd-7e33-4bb3-8eb1-8ee1869543d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51fd1131-e2e1-4400-b771-e967f848fde7', 'volume_size': 2}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:22 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09820ac4-2df4-4ba0-89de-9380aaacd278 1073741824 Jul 03 01:11:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8db6a2c-b43d-4ff7-8814-8e1ac78fc022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:22 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:22 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Volume volume-51fd1131-e2e1-4400-b771-e967f848fde7 (51fd1131-e2e1-4400-b771-e967f848fde7): created successfully Jul 03 01:11:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8db6a2c-b43d-4ff7-8814-8e1ac78fc022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Flow 'volume_create_manager' (93a0cb77-2bbe-4095-8cea-ed94ec7763f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:22 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-33fe5aa9-1950-4059-89bd-679c8d305758 tempest-VolumesCloneNegativeTest-1052245846 None] Created volume successfully. Jul 03 01:11:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d7cc71c2-62c8-425b-801c-2f73fe2a1c83 tempest-VolumesActionsTest-1490173328 None] Acquiring lock "cinder-7127e024-7a98-42e4-a0cf-aaefb05a62da-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d7cc71c2-62c8-425b-801c-2f73fe2a1c83 tempest-VolumesActionsTest-1490173328 None] Lock "cinder-7127e024-7a98-42e4-a0cf-aaefb05a62da-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d7cc71c2-62c8-425b-801c-2f73fe2a1c83 tempest-VolumesActionsTest-1490173328 None] Acquiring lock "cinder-quobyte-7127e024-7a98-42e4-a0cf-aaefb05a62da" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d7cc71c2-62c8-425b-801c-2f73fe2a1c83 tempest-VolumesActionsTest-1490173328 None] Lock "cinder-quobyte-7127e024-7a98-42e4-a0cf-aaefb05a62da" acquired by "delete_volume" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:23 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0ada4d-eb7a-4661-9bf3-a73e7bd9ed4f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d7cc71c2-62c8-425b-801c-2f73fe2a1c83 tempest-VolumesActionsTest-1490173328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7127e024-7a98-42e4-a0cf-aaefb05a62da {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:23 devstack sudo[96273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7127e024-7a98-42e4-a0cf-aaefb05a62da Jul 03 01:11:23 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-eebb3c26-5e3f-4566-9eac-120c51e70c60 tempest-VolumesCloneNegativeTest-1052245846 None] Acquiring lock "cinder-51fd1131-e2e1-4400-b771-e967f848fde7-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-eebb3c26-5e3f-4566-9eac-120c51e70c60 tempest-VolumesCloneNegativeTest-1052245846 None] Lock "cinder-51fd1131-e2e1-4400-b771-e967f848fde7-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-eebb3c26-5e3f-4566-9eac-120c51e70c60 tempest-VolumesCloneNegativeTest-1052245846 None] Acquiring lock "cinder-quobyte-51fd1131-e2e1-4400-b771-e967f848fde7" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-eebb3c26-5e3f-4566-9eac-120c51e70c60 tempest-VolumesCloneNegativeTest-1052245846 None] Lock "cinder-quobyte-51fd1131-e2e1-4400-b771-e967f848fde7" acquired by "delete_volume" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:23 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f441286c-e02d-45e4-9a27-faae35b54c91]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eebb3c26-5e3f-4566-9eac-120c51e70c60 tempest-VolumesCloneNegativeTest-1052245846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-51fd1131-e2e1-4400-b771-e967f848fde7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:23 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-51fd1131-e2e1-4400-b771-e967f848fde7 Jul 03 01:11:23 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:24 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09820ac4-2df4-4ba0-89de-9380aaacd278 1073741824" returned: 0 in 1.946s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:24 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d7cc71c2-62c8-425b-801c-2f73fe2a1c83 tempest-VolumesActionsTest-1490173328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7127e024-7a98-42e4-a0cf-aaefb05a62da" returned: 0 in 1.360s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d7cc71c2-62c8-425b-801c-2f73fe2a1c83 tempest-VolumesActionsTest-1490173328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7127e024-7a98-42e4-a0cf-aaefb05a62da {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09820ac4-2df4-4ba0-89de-9380aaacd278 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:24 devstack sudo[96352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7127e024-7a98-42e4-a0cf-aaefb05a62da Jul 03 01:11:24 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:24 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09820ac4-2df4-4ba0-89de-9380aaacd278 Jul 03 01:11:24 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:25 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eebb3c26-5e3f-4566-9eac-120c51e70c60 tempest-VolumesCloneNegativeTest-1052245846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-51fd1131-e2e1-4400-b771-e967f848fde7" returned: 0 in 1.490s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eebb3c26-5e3f-4566-9eac-120c51e70c60 tempest-VolumesCloneNegativeTest-1052245846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-51fd1131-e2e1-4400-b771-e967f848fde7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:25 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-51fd1131-e2e1-4400-b771-e967f848fde7 Jul 03 01:11:25 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:25 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d7cc71c2-62c8-425b-801c-2f73fe2a1c83 tempest-VolumesActionsTest-1490173328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7127e024-7a98-42e4-a0cf-aaefb05a62da" returned: 0 in 0.955s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d7cc71c2-62c8-425b-801c-2f73fe2a1c83 tempest-VolumesActionsTest-1490173328 None] Lock "cinder-quobyte-7127e024-7a98-42e4-a0cf-aaefb05a62da" released by "delete_volume" :: held 2.423s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:25 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09820ac4-2df4-4ba0-89de-9380aaacd278" returned: 0 in 1.020s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] <== create_volume: return (3044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:11:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.047s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb7e520c-a434-485c-b417-3373b6211dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09820ac4-2df4-4ba0-89de-9380aaacd278', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14467ac8-0112-42ef-ac1a-dbd639693dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:25 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-d7cc71c2-62c8-425b-801c-2f73fe2a1c83 tempest-VolumesActionsTest-1490173328 None] Created reservations ['aaa0ffbd-d61e-4a33-b870-d1b8660760e4', 'a3e43a41-f3bf-45ac-a281-a4072ba7e697', '1caddd0c-9684-4210-bb3e-f658f47067ba', '8ebb8a39-84c3-4977-ace2-6bba2e2ca4fc'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:11:25 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Volume volume-09820ac4-2df4-4ba0-89de-9380aaacd278 (09820ac4-2df4-4ba0-89de-9380aaacd278): created successfully Jul 03 01:11:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14467ac8-0112-42ef-ac1a-dbd639693dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Flow 'volume_create_manager' (2c8bc071-6132-47ae-b6fa-398953d6ceba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:25 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5d862e0d-b4e0-4fe2-91a8-55854efd9a7b tempest-VolumesTestJSON-1685263663 None] Created volume successfully. Jul 03 01:11:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d7cc71c2-62c8-425b-801c-2f73fe2a1c83 tempest-VolumesActionsTest-1490173328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d7cc71c2-62c8-425b-801c-2f73fe2a1c83 tempest-VolumesActionsTest-1490173328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d7cc71c2-62c8-425b-801c-2f73fe2a1c83 tempest-VolumesActionsTest-1490173328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d7cc71c2-62c8-425b-801c-2f73fe2a1c83 tempest-VolumesActionsTest-1490173328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d7cc71c2-62c8-425b-801c-2f73fe2a1c83 tempest-VolumesActionsTest-1490173328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d7cc71c2-62c8-425b-801c-2f73fe2a1c83 tempest-VolumesActionsTest-1490173328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:25 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:11:25 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:26 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eebb3c26-5e3f-4566-9eac-120c51e70c60 tempest-VolumesCloneNegativeTest-1052245846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-51fd1131-e2e1-4400-b771-e967f848fde7" returned: 0 in 0.868s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-eebb3c26-5e3f-4566-9eac-120c51e70c60 tempest-VolumesCloneNegativeTest-1052245846 None] Lock "cinder-quobyte-51fd1131-e2e1-4400-b771-e967f848fde7" released by "delete_volume" :: held 2.438s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:26 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-eebb3c26-5e3f-4566-9eac-120c51e70c60 tempest-VolumesCloneNegativeTest-1052245846 None] Created reservations ['6cecf198-c258-4b01-a527-7beeabe11114', '89e8cc38-3fe9-4668-80b6-349ab06b1ad3', 'f7544977-b3c2-4343-a499-40094d4ee53a', '055d5e9e-0889-4647-b24e-e5429375699b'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:11:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-eebb3c26-5e3f-4566-9eac-120c51e70c60 tempest-VolumesCloneNegativeTest-1052245846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-eebb3c26-5e3f-4566-9eac-120c51e70c60 tempest-VolumesCloneNegativeTest-1052245846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-eebb3c26-5e3f-4566-9eac-120c51e70c60 tempest-VolumesCloneNegativeTest-1052245846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-eebb3c26-5e3f-4566-9eac-120c51e70c60 tempest-VolumesCloneNegativeTest-1052245846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-eebb3c26-5e3f-4566-9eac-120c51e70c60 tempest-VolumesCloneNegativeTest-1052245846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eebb3c26-5e3f-4566-9eac-120c51e70c60 tempest-VolumesCloneNegativeTest-1052245846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:26 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:11:26 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:26 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d7cc71c2-62c8-425b-801c-2f73fe2a1c83 tempest-VolumesActionsTest-1490173328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.814s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:26 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-d7cc71c2-62c8-425b-801c-2f73fe2a1c83 tempest-VolumesActionsTest-1490173328 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:11:26 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d7cc71c2-62c8-425b-801c-2f73fe2a1c83 tempest-VolumesActionsTest-1490173328 None] Deleted volume successfully. Jul 03 01:11:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d7cc71c2-62c8-425b-801c-2f73fe2a1c83 tempest-VolumesActionsTest-1490173328 None] Lock "cinder-7127e024-7a98-42e4-a0cf-aaefb05a62da-delete_volume" released by "delete_volume" :: held 3.659s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:27 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-eebb3c26-5e3f-4566-9eac-120c51e70c60 tempest-VolumesCloneNegativeTest-1052245846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.888s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:27 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-eebb3c26-5e3f-4566-9eac-120c51e70c60 tempest-VolumesCloneNegativeTest-1052245846 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:11:27 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-eebb3c26-5e3f-4566-9eac-120c51e70c60 tempest-VolumesCloneNegativeTest-1052245846 None] Deleted volume successfully. Jul 03 01:11:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-eebb3c26-5e3f-4566-9eac-120c51e70c60 tempest-VolumesCloneNegativeTest-1052245846 None] Lock "cinder-51fd1131-e2e1-4400-b771-e967f848fde7-delete_volume" released by "delete_volume" :: held 3.708s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-342d0926-5b59-477d-9c77-b55c8d3658a9 tempest-VolumesTestJSON-1685263663 None] Acquiring lock "cinder-09820ac4-2df4-4ba0-89de-9380aaacd278-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-342d0926-5b59-477d-9c77-b55c8d3658a9 tempest-VolumesTestJSON-1685263663 None] Lock "cinder-09820ac4-2df4-4ba0-89de-9380aaacd278-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-342d0926-5b59-477d-9c77-b55c8d3658a9 tempest-VolumesTestJSON-1685263663 None] Acquiring lock "cinder-quobyte-09820ac4-2df4-4ba0-89de-9380aaacd278" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-342d0926-5b59-477d-9c77-b55c8d3658a9 tempest-VolumesTestJSON-1685263663 None] Lock "cinder-quobyte-09820ac4-2df4-4ba0-89de-9380aaacd278" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:27 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4d37a1-9016-48a7-b1f3-e5860a24244e]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-342d0926-5b59-477d-9c77-b55c8d3658a9 tempest-VolumesTestJSON-1685263663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09820ac4-2df4-4ba0-89de-9380aaacd278 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:27 devstack sudo[96374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09820ac4-2df4-4ba0-89de-9380aaacd278 Jul 03 01:11:27 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:28 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-342d0926-5b59-477d-9c77-b55c8d3658a9 tempest-VolumesTestJSON-1685263663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09820ac4-2df4-4ba0-89de-9380aaacd278" returned: 0 in 0.934s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-342d0926-5b59-477d-9c77-b55c8d3658a9 tempest-VolumesTestJSON-1685263663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09820ac4-2df4-4ba0-89de-9380aaacd278 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:28 devstack sudo[96380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09820ac4-2df4-4ba0-89de-9380aaacd278 Jul 03 01:11:28 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:29 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-342d0926-5b59-477d-9c77-b55c8d3658a9 tempest-VolumesTestJSON-1685263663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09820ac4-2df4-4ba0-89de-9380aaacd278" returned: 0 in 0.810s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-342d0926-5b59-477d-9c77-b55c8d3658a9 tempest-VolumesTestJSON-1685263663 None] Lock "cinder-quobyte-09820ac4-2df4-4ba0-89de-9380aaacd278" released by "delete_volume" :: held 1.807s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:29 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-342d0926-5b59-477d-9c77-b55c8d3658a9 tempest-VolumesTestJSON-1685263663 None] Created reservations ['dd641da8-12ae-4fb6-beca-8dd30c3f2ce4', 'c4f1a7dd-6c47-4c8f-b6e1-480a61b096b3', 'ac57adb5-a703-4bd5-899d-4bbaca1dc3f4', '31fcf016-69b6-4b45-8cb1-807fff857362'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:11:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-342d0926-5b59-477d-9c77-b55c8d3658a9 tempest-VolumesTestJSON-1685263663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-342d0926-5b59-477d-9c77-b55c8d3658a9 tempest-VolumesTestJSON-1685263663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-342d0926-5b59-477d-9c77-b55c8d3658a9 tempest-VolumesTestJSON-1685263663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-342d0926-5b59-477d-9c77-b55c8d3658a9 tempest-VolumesTestJSON-1685263663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-342d0926-5b59-477d-9c77-b55c8d3658a9 tempest-VolumesTestJSON-1685263663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-342d0926-5b59-477d-9c77-b55c8d3658a9 tempest-VolumesTestJSON-1685263663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:29 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:11:29 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e16ca1e8-c043-4ed1-84d2-f7781578f47e tempest-VolumesTestJSON-1685263663 None] Acquiring lock "cinder-d21bdd28-5d55-4ddf-958e-ee59a65d1bff-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e16ca1e8-c043-4ed1-84d2-f7781578f47e tempest-VolumesTestJSON-1685263663 None] Lock "cinder-d21bdd28-5d55-4ddf-958e-ee59a65d1bff-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e16ca1e8-c043-4ed1-84d2-f7781578f47e tempest-VolumesTestJSON-1685263663 None] Acquiring lock "cinder-quobyte-d21bdd28-5d55-4ddf-958e-ee59a65d1bff" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e16ca1e8-c043-4ed1-84d2-f7781578f47e tempest-VolumesTestJSON-1685263663 None] Lock "cinder-quobyte-d21bdd28-5d55-4ddf-958e-ee59a65d1bff" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:30 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9753432a-44e4-44a1-8663-d2b20c12ab93]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e16ca1e8-c043-4ed1-84d2-f7781578f47e tempest-VolumesTestJSON-1685263663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d21bdd28-5d55-4ddf-958e-ee59a65d1bff {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:30 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d21bdd28-5d55-4ddf-958e-ee59a65d1bff Jul 03 01:11:30 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:30 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-342d0926-5b59-477d-9c77-b55c8d3658a9 tempest-VolumesTestJSON-1685263663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.031s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:30 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-342d0926-5b59-477d-9c77-b55c8d3658a9 tempest-VolumesTestJSON-1685263663 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:11:30 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-342d0926-5b59-477d-9c77-b55c8d3658a9 tempest-VolumesTestJSON-1685263663 None] Deleted volume successfully. Jul 03 01:11:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-342d0926-5b59-477d-9c77-b55c8d3658a9 tempest-VolumesTestJSON-1685263663 None] Lock "cinder-09820ac4-2df4-4ba0-89de-9380aaacd278-delete_volume" released by "delete_volume" :: held 3.084s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:31 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:11:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Flow 'volume_create_manager' (9f0b9853-d9c2-4e64-b952-c65a09e99470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef81cc74-1272-42fd-8655-efc3226d1e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef81cc74-1272-42fd-8655-efc3226d1e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1839064524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd2661a0-58c5-42c1-a411-7912387001a7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6354242950304d4ea09e1cd99a0a4c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:31Z,use_quota=True,user_id='fef647283c8f44fe9bd38698c904df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276c6e76-b836-4408-8e47-7116e68d5141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276c6e76-b836-4408-8e47-7116e68d5141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (921a364e-f674-4e6e-9363-937a31949bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (921a364e-f674-4e6e-9363-937a31949bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd2661a0-58c5-42c1-a411-7912387001a7', 'volume_name': 'volume-cd2661a0-58c5-42c1-a411-7912387001a7', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa5ca696-007c-4688-8de6-763c6617febb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa5ca696-007c-4688-8de6-763c6617febb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837e0a3b-beb6-4e02-a20a-b63477f7db99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:31 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Volume cd2661a0-58c5-42c1-a411-7912387001a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd2661a0-58c5-42c1-a411-7912387001a7', 'volume_size': 1} Jul 03 01:11:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1839064524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd2661a0-58c5-42c1-a411-7912387001a7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6354242950304d4ea09e1cd99a0a4c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:31Z,use_quota=True,user_id='fef647283c8f44fe9bd38698c904df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:11:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Creating volume cd2661a0-58c5-42c1-a411-7912387001a7 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:11:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:11:31 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:11:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cd2661a0-58c5-42c1-a411-7912387001a7 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:31 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e16ca1e8-c043-4ed1-84d2-f7781578f47e tempest-VolumesTestJSON-1685263663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d21bdd28-5d55-4ddf-958e-ee59a65d1bff" returned: 0 in 1.004s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e16ca1e8-c043-4ed1-84d2-f7781578f47e tempest-VolumesTestJSON-1685263663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d21bdd28-5d55-4ddf-958e-ee59a65d1bff {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:31 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cd2661a0-58c5-42c1-a411-7912387001a7 1073741824 Jul 03 01:11:31 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:31 devstack sudo[96394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d21bdd28-5d55-4ddf-958e-ee59a65d1bff Jul 03 01:11:31 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:32 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e16ca1e8-c043-4ed1-84d2-f7781578f47e tempest-VolumesTestJSON-1685263663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d21bdd28-5d55-4ddf-958e-ee59a65d1bff" returned: 0 in 0.830s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e16ca1e8-c043-4ed1-84d2-f7781578f47e tempest-VolumesTestJSON-1685263663 None] Lock "cinder-quobyte-d21bdd28-5d55-4ddf-958e-ee59a65d1bff" released by "delete_volume" :: held 1.899s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:32 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e16ca1e8-c043-4ed1-84d2-f7781578f47e tempest-VolumesTestJSON-1685263663 None] Created reservations ['c5608c9f-9457-4255-87c3-99b542023138', '33ef45e1-4203-4500-a67f-3c65037ce683', 'e53cc204-a184-4ef6-9968-77b3db7579ab', '5a6a13a7-8cd5-45bf-9159-a753a2aec58e'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:11:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e16ca1e8-c043-4ed1-84d2-f7781578f47e tempest-VolumesTestJSON-1685263663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e16ca1e8-c043-4ed1-84d2-f7781578f47e tempest-VolumesTestJSON-1685263663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e16ca1e8-c043-4ed1-84d2-f7781578f47e tempest-VolumesTestJSON-1685263663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e16ca1e8-c043-4ed1-84d2-f7781578f47e tempest-VolumesTestJSON-1685263663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e16ca1e8-c043-4ed1-84d2-f7781578f47e tempest-VolumesTestJSON-1685263663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e16ca1e8-c043-4ed1-84d2-f7781578f47e tempest-VolumesTestJSON-1685263663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:32 devstack sudo[96430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:11:32 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7911ab8c-3298-470f-b51d-b7212f1e522e tempest-VolumesTestJSON-1685263663 None] Acquiring lock "cinder-a566fd97-f199-4eb4-8421-9cbb6d928826-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7911ab8c-3298-470f-b51d-b7212f1e522e tempest-VolumesTestJSON-1685263663 None] Lock "cinder-a566fd97-f199-4eb4-8421-9cbb6d928826-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:32 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cd2661a0-58c5-42c1-a411-7912387001a7 1073741824" returned: 0 in 1.247s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7911ab8c-3298-470f-b51d-b7212f1e522e tempest-VolumesTestJSON-1685263663 None] Acquiring lock "cinder-quobyte-a566fd97-f199-4eb4-8421-9cbb6d928826" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7911ab8c-3298-470f-b51d-b7212f1e522e tempest-VolumesTestJSON-1685263663 None] Lock "cinder-quobyte-a566fd97-f199-4eb4-8421-9cbb6d928826" acquired by "delete_volume" :: waited 0.049s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cd2661a0-58c5-42c1-a411-7912387001a7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:32 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[62def5cb-04e3-4eae-a8ea-502e01a0cbc9]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7911ab8c-3298-470f-b51d-b7212f1e522e tempest-VolumesTestJSON-1685263663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a566fd97-f199-4eb4-8421-9cbb6d928826 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:32 devstack sudo[96497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cd2661a0-58c5-42c1-a411-7912387001a7 Jul 03 01:11:32 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:32 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a566fd97-f199-4eb4-8421-9cbb6d928826 Jul 03 01:11:32 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:33 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e16ca1e8-c043-4ed1-84d2-f7781578f47e tempest-VolumesTestJSON-1685263663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.942s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:33 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-e16ca1e8-c043-4ed1-84d2-f7781578f47e tempest-VolumesTestJSON-1685263663 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:11:33 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e16ca1e8-c043-4ed1-84d2-f7781578f47e tempest-VolumesTestJSON-1685263663 None] Deleted volume successfully. Jul 03 01:11:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e16ca1e8-c043-4ed1-84d2-f7781578f47e tempest-VolumesTestJSON-1685263663 None] Lock "cinder-d21bdd28-5d55-4ddf-958e-ee59a65d1bff-delete_volume" released by "delete_volume" :: held 3.140s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:33 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cd2661a0-58c5-42c1-a411-7912387001a7" returned: 0 in 0.859s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] <== create_volume: return (2265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:11:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.268s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837e0a3b-beb6-4e02-a20a-b63477f7db99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd2661a0-58c5-42c1-a411-7912387001a7', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e392c9-19f7-4791-bbaa-ee2d3110ac8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:33 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Volume volume-cd2661a0-58c5-42c1-a411-7912387001a7 (cd2661a0-58c5-42c1-a411-7912387001a7): created successfully Jul 03 01:11:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e392c9-19f7-4791-bbaa-ee2d3110ac8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Flow 'volume_create_manager' (9f0b9853-d9c2-4e64-b952-c65a09e99470) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:33 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-005393cc-b7d0-4e74-9993-685e45519332 tempest-VolumesGetTest-1433751156 None] Created volume successfully. Jul 03 01:11:33 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7911ab8c-3298-470f-b51d-b7212f1e522e tempest-VolumesTestJSON-1685263663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a566fd97-f199-4eb4-8421-9cbb6d928826" returned: 0 in 1.062s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7911ab8c-3298-470f-b51d-b7212f1e522e tempest-VolumesTestJSON-1685263663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a566fd97-f199-4eb4-8421-9cbb6d928826 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:33 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a566fd97-f199-4eb4-8421-9cbb6d928826 Jul 03 01:11:33 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:34 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7911ab8c-3298-470f-b51d-b7212f1e522e tempest-VolumesTestJSON-1685263663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a566fd97-f199-4eb4-8421-9cbb6d928826" returned: 0 in 0.772s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7911ab8c-3298-470f-b51d-b7212f1e522e tempest-VolumesTestJSON-1685263663 None] Lock "cinder-quobyte-a566fd97-f199-4eb4-8421-9cbb6d928826" released by "delete_volume" :: held 1.912s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:34 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-7911ab8c-3298-470f-b51d-b7212f1e522e tempest-VolumesTestJSON-1685263663 None] Created reservations ['437e4c6c-1f52-416d-badb-5e8b6a6729f0', 'a2db63e9-68af-4b95-9227-73987291de0b', '2c6c9782-54a3-4787-95d3-d81675ab9fb1', '049d0754-fcba-474a-a361-5028443cc526'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:11:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7911ab8c-3298-470f-b51d-b7212f1e522e tempest-VolumesTestJSON-1685263663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7911ab8c-3298-470f-b51d-b7212f1e522e tempest-VolumesTestJSON-1685263663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7911ab8c-3298-470f-b51d-b7212f1e522e tempest-VolumesTestJSON-1685263663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7911ab8c-3298-470f-b51d-b7212f1e522e tempest-VolumesTestJSON-1685263663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7911ab8c-3298-470f-b51d-b7212f1e522e tempest-VolumesTestJSON-1685263663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7911ab8c-3298-470f-b51d-b7212f1e522e tempest-VolumesTestJSON-1685263663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:34 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:11:34 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:35 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:11:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Flow 'volume_create_manager' (90836bd0-d48a-4f49-a05a-172719f8c6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cbdf83b-ba44-4bec-91a8-ddd5f8154bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cbdf83b-ba44-4bec-91a8-ddd5f8154bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1135611321',display_name='tempest-VolumesGetTest-Volume-1885288735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bbd4d29-4633-407f-b656-34205eae27ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6354242950304d4ea09e1cd99a0a4c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:35Z,use_quota=True,user_id='fef647283c8f44fe9bd38698c904df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e500b26-027a-47f1-87d1-a7263514dbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e500b26-027a-47f1-87d1-a7263514dbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63277644-10e4-43c8-b109-00824faaf8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63277644-10e4-43c8-b109-00824faaf8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bbd4d29-4633-407f-b656-34205eae27ce', 'volume_name': 'volume-5bbd4d29-4633-407f-b656-34205eae27ce', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:35 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2166bc48-f7d4-4b18-aeaa-823300025602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2166bc48-f7d4-4b18-aeaa-823300025602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc03b4b6-280c-46f8-a9f6-f74dd1ce9a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:35 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Volume 5bbd4d29-4633-407f-b656-34205eae27ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bbd4d29-4633-407f-b656-34205eae27ce', 'volume_size': 1} Jul 03 01:11:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1135611321',display_name='tempest-VolumesGetTest-Volume-1885288735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bbd4d29-4633-407f-b656-34205eae27ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6354242950304d4ea09e1cd99a0a4c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:35Z,use_quota=True,user_id='fef647283c8f44fe9bd38698c904df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:11:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Creating volume 5bbd4d29-4633-407f-b656-34205eae27ce {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:11:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:11:35 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:11:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5bbd4d29-4633-407f-b656-34205eae27ce 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7911ab8c-3298-470f-b51d-b7212f1e522e tempest-VolumesTestJSON-1685263663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.208s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:35 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-7911ab8c-3298-470f-b51d-b7212f1e522e tempest-VolumesTestJSON-1685263663 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:11:35 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7911ab8c-3298-470f-b51d-b7212f1e522e tempest-VolumesTestJSON-1685263663 None] Deleted volume successfully. Jul 03 01:11:35 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5bbd4d29-4633-407f-b656-34205eae27ce 1073741824 Jul 03 01:11:35 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7911ab8c-3298-470f-b51d-b7212f1e522e tempest-VolumesTestJSON-1685263663 None] Lock "cinder-a566fd97-f199-4eb4-8421-9cbb6d928826-delete_volume" released by "delete_volume" :: held 3.599s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:37 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5bbd4d29-4633-407f-b656-34205eae27ce 1073741824" returned: 0 in 1.827s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5bbd4d29-4633-407f-b656-34205eae27ce {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:37 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5bbd4d29-4633-407f-b656-34205eae27ce Jul 03 01:11:37 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:39 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5bbd4d29-4633-407f-b656-34205eae27ce" returned: 0 in 1.323s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] <== create_volume: return (3214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:11:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.221s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc03b4b6-280c-46f8-a9f6-f74dd1ce9a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bbd4d29-4633-407f-b656-34205eae27ce', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f6cc8c-d4f6-4fe2-90a9-44e9ac8bc50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:39 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Volume volume-5bbd4d29-4633-407f-b656-34205eae27ce (5bbd4d29-4633-407f-b656-34205eae27ce): created successfully Jul 03 01:11:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f6cc8c-d4f6-4fe2-90a9-44e9ac8bc50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Flow 'volume_create_manager' (90836bd0-d48a-4f49-a05a-172719f8c6d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:39 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5a8dfd4c-f701-42b5-a5fa-cc5b0e38fdf4 tempest-VolumesGetTest-1433751156 None] Created volume successfully. Jul 03 01:11:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-039d7f76-1e3b-450e-930e-cd3b51cae0cf tempest-VolumesGetTest-1433751156 None] Acquiring lock "cinder-5bbd4d29-4633-407f-b656-34205eae27ce-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-039d7f76-1e3b-450e-930e-cd3b51cae0cf tempest-VolumesGetTest-1433751156 None] Lock "cinder-5bbd4d29-4633-407f-b656-34205eae27ce-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-039d7f76-1e3b-450e-930e-cd3b51cae0cf tempest-VolumesGetTest-1433751156 None] Acquiring lock "cinder-quobyte-5bbd4d29-4633-407f-b656-34205eae27ce" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-039d7f76-1e3b-450e-930e-cd3b51cae0cf tempest-VolumesGetTest-1433751156 None] Lock "cinder-quobyte-5bbd4d29-4633-407f-b656-34205eae27ce" acquired by "delete_volume" :: waited 0.036s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:40 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55e88d4-9497-4fa1-a152-5e5d3e73abec]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-039d7f76-1e3b-450e-930e-cd3b51cae0cf tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5bbd4d29-4633-407f-b656-34205eae27ce {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:40 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5bbd4d29-4633-407f-b656-34205eae27ce Jul 03 01:11:40 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:41 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-039d7f76-1e3b-450e-930e-cd3b51cae0cf tempest-VolumesGetTest-1433751156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5bbd4d29-4633-407f-b656-34205eae27ce" returned: 0 in 0.945s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-039d7f76-1e3b-450e-930e-cd3b51cae0cf tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5bbd4d29-4633-407f-b656-34205eae27ce {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:41 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5bbd4d29-4633-407f-b656-34205eae27ce Jul 03 01:11:41 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:42 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-039d7f76-1e3b-450e-930e-cd3b51cae0cf tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5bbd4d29-4633-407f-b656-34205eae27ce" returned: 0 in 0.909s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-039d7f76-1e3b-450e-930e-cd3b51cae0cf tempest-VolumesGetTest-1433751156 None] Lock "cinder-quobyte-5bbd4d29-4633-407f-b656-34205eae27ce" released by "delete_volume" :: held 1.938s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:42 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-04fb3245-f949-4d36-95ee-18c808136923 tempest-GroupSnapshotsV319Test-749322682 None] Group tempest-GroupSnapshotsV319Test-Group-486770454: creating Jul 03 01:11:42 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-039d7f76-1e3b-450e-930e-cd3b51cae0cf tempest-VolumesGetTest-1433751156 None] Created reservations ['74357ed7-192e-4944-af18-77214bb27175', '75d7738c-8474-42bf-9d55-e8404283b5fb', 'e61478c3-4a02-4f01-b32a-f121fbbed7df', '222b196f-d423-4144-b445-c91918797ffc'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:11:42 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-04fb3245-f949-4d36-95ee-18c808136923 tempest-GroupSnapshotsV319Test-749322682 None] Group tempest-GroupSnapshotsV319Test-Group-486770454: created successfully Jul 03 01:11:42 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-04fb3245-f949-4d36-95ee-18c808136923 tempest-GroupSnapshotsV319Test-749322682 None] Create group completed successfully. Jul 03 01:11:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-039d7f76-1e3b-450e-930e-cd3b51cae0cf tempest-VolumesGetTest-1433751156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-039d7f76-1e3b-450e-930e-cd3b51cae0cf tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-039d7f76-1e3b-450e-930e-cd3b51cae0cf tempest-VolumesGetTest-1433751156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-039d7f76-1e3b-450e-930e-cd3b51cae0cf tempest-VolumesGetTest-1433751156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-039d7f76-1e3b-450e-930e-cd3b51cae0cf tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-039d7f76-1e3b-450e-930e-cd3b51cae0cf tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:42 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:11:42 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:43 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-039d7f76-1e3b-450e-930e-cd3b51cae0cf tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.717s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:43 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-039d7f76-1e3b-450e-930e-cd3b51cae0cf tempest-VolumesGetTest-1433751156 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:11:43 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-039d7f76-1e3b-450e-930e-cd3b51cae0cf tempest-VolumesGetTest-1433751156 None] Deleted volume successfully. Jul 03 01:11:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-039d7f76-1e3b-450e-930e-cd3b51cae0cf tempest-VolumesGetTest-1433751156 None] Lock "cinder-5bbd4d29-4633-407f-b656-34205eae27ce-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-72aeec6d-e74b-4e3f-a4fd-4545977df7cc tempest-VolumesGetTest-1433751156 None] Acquiring lock "cinder-cd2661a0-58c5-42c1-a411-7912387001a7-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-72aeec6d-e74b-4e3f-a4fd-4545977df7cc tempest-VolumesGetTest-1433751156 None] Lock "cinder-cd2661a0-58c5-42c1-a411-7912387001a7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-72aeec6d-e74b-4e3f-a4fd-4545977df7cc tempest-VolumesGetTest-1433751156 None] Acquiring lock "cinder-quobyte-cd2661a0-58c5-42c1-a411-7912387001a7" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-72aeec6d-e74b-4e3f-a4fd-4545977df7cc tempest-VolumesGetTest-1433751156 None] Lock "cinder-quobyte-cd2661a0-58c5-42c1-a411-7912387001a7" acquired by "delete_volume" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:43 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c629bd-02db-4425-96e6-465aeb4daa68]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-72aeec6d-e74b-4e3f-a4fd-4545977df7cc tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cd2661a0-58c5-42c1-a411-7912387001a7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:44 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cd2661a0-58c5-42c1-a411-7912387001a7 Jul 03 01:11:44 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:44 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:11:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Flow 'volume_create_manager' (55cb2c22-7fe3-4633-a99f-68aadf70208c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (172ea3f1-4b2a-474d-9eaf-bee57686852d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (172ea3f1-4b2a-474d-9eaf-bee57686852d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-624031888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7d2cee32-ff77-4444-a636-0c61d81cec6e,host='devstack@QuobyteHD#QuobyteHD',id=9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c37071b3ebf4c5bacefa8451bca2056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:44Z,use_quota=True,user_id='9797930026414fe58cae71a539ff598f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83747f5c-bde6-4846-9f68-aedb3fda9ae6),volume_type_id=83747f5c-bde6-4846-9f68-aedb3fda9ae6)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f48f42-9505-4638-98cf-ecc78afd8890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f48f42-9505-4638-98cf-ecc78afd8890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2424ea45-63a4-4e9a-89ce-32d8efd65ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2424ea45-63a4-4e9a-89ce-32d8efd65ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7', 'volume_name': 'volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a8bdeb-bf7e-4021-b487-ce4917b88f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a8bdeb-bf7e-4021-b487-ce4917b88f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68fbef35-4ee5-4ec6-b217-b10df8825bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:44 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Volume 9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7', 'volume_size': 1} Jul 03 01:11:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7d2cee32-ff77-4444-a636-0c61d81cec6e,created_at=2026-07-02T23:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-624031888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7d2cee32-ff77-4444-a636-0c61d81cec6e,host='devstack@QuobyteHD#QuobyteHD',id=9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c37071b3ebf4c5bacefa8451bca2056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:44Z,use_quota=True,user_id='9797930026414fe58cae71a539ff598f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83747f5c-bde6-4846-9f68-aedb3fda9ae6),volume_type_id=83747f5c-bde6-4846-9f68-aedb3fda9ae6)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:11:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Creating volume 9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:11:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:11:44 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:11:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:44 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7 1073741824 Jul 03 01:11:44 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:44 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-72aeec6d-e74b-4e3f-a4fd-4545977df7cc tempest-VolumesGetTest-1433751156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cd2661a0-58c5-42c1-a411-7912387001a7" returned: 0 in 1.213s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-72aeec6d-e74b-4e3f-a4fd-4545977df7cc tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cd2661a0-58c5-42c1-a411-7912387001a7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:45 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cd2661a0-58c5-42c1-a411-7912387001a7 Jul 03 01:11:45 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:45 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7 1073741824" returned: 0 in 1.130s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:45 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7 Jul 03 01:11:45 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:45 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-72aeec6d-e74b-4e3f-a4fd-4545977df7cc tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cd2661a0-58c5-42c1-a411-7912387001a7" returned: 0 in 0.863s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-72aeec6d-e74b-4e3f-a4fd-4545977df7cc tempest-VolumesGetTest-1433751156 None] Lock "cinder-quobyte-cd2661a0-58c5-42c1-a411-7912387001a7" released by "delete_volume" :: held 2.167s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:45 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-72aeec6d-e74b-4e3f-a4fd-4545977df7cc tempest-VolumesGetTest-1433751156 None] Created reservations ['256949c7-ffd6-4e38-98a4-9fac0936c43e', '89eccbc9-eb1d-461d-99f5-6bbcdc4cc079', '0e085266-229b-4095-8c49-e2d8abafdf6d', '90afaca2-85a0-428b-b3c5-28f7630bb6b2'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Flow 'volume_create_manager' (374b9a0e-cd83-46d1-9816-dd46fef8fc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (492e8267-d002-4ce6-85eb-72ceeb4cd502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (492e8267-d002-4ce6-85eb-72ceeb4cd502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1139467554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1c095f-2860-48e6-80f5-1a6a98ebdb19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='885f542cda3b4142ab50b15e5b25984e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:46Z,use_quota=True,user_id='cf7898a5dfb24a2594bea7059f8b130f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4454a2ee-5d1f-429d-8436-27420c10c043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4454a2ee-5d1f-429d-8436-27420c10c043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f394c1cb-cf4e-4c27-b092-aad03140c361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f394c1cb-cf4e-4c27-b092-aad03140c361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed1c095f-2860-48e6-80f5-1a6a98ebdb19', 'volume_name': 'volume-ed1c095f-2860-48e6-80f5-1a6a98ebdb19', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43827205-194d-49b1-b1d3-0f780fdd3124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43827205-194d-49b1-b1d3-0f780fdd3124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69e50d3-0775-4e5e-8171-f853e7cbc280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:46 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Volume ed1c095f-2860-48e6-80f5-1a6a98ebdb19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed1c095f-2860-48e6-80f5-1a6a98ebdb19', 'volume_size': 1} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-72aeec6d-e74b-4e3f-a4fd-4545977df7cc tempest-VolumesGetTest-1433751156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-72aeec6d-e74b-4e3f-a4fd-4545977df7cc tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-72aeec6d-e74b-4e3f-a4fd-4545977df7cc tempest-VolumesGetTest-1433751156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-72aeec6d-e74b-4e3f-a4fd-4545977df7cc tempest-VolumesGetTest-1433751156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-72aeec6d-e74b-4e3f-a4fd-4545977df7cc tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-72aeec6d-e74b-4e3f-a4fd-4545977df7cc tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:46 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:11:46 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:46 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7" returned: 0 in 0.771s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] <== create_volume: return (1984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.287s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1139467554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1c095f-2860-48e6-80f5-1a6a98ebdb19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='885f542cda3b4142ab50b15e5b25984e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:46Z,use_quota=True,user_id='cf7898a5dfb24a2594bea7059f8b130f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Creating volume ed1c095f-2860-48e6-80f5-1a6a98ebdb19 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:11:46 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ed1c095f-2860-48e6-80f5-1a6a98ebdb19 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:46 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ed1c095f-2860-48e6-80f5-1a6a98ebdb19 1073741824 Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68fbef35-4ee5-4ec6-b217-b10df8825bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:46 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6008eea-64f0-490e-9cf9-d5d7d0a8c973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:46 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Volume volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7 (9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7): created successfully Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6008eea-64f0-490e-9cf9-d5d7d0a8c973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Flow 'volume_create_manager' (55cb2c22-7fe3-4633-a99f-68aadf70208c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:46 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b9b82210-6858-4fea-918f-8f89ea5d03cd tempest-GroupSnapshotsV319Test-749322682 None] Created volume successfully. Jul 03 01:11:46 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-72aeec6d-e74b-4e3f-a4fd-4545977df7cc tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.761s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-72aeec6d-e74b-4e3f-a4fd-4545977df7cc tempest-VolumesGetTest-1433751156 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:11:46 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-72aeec6d-e74b-4e3f-a4fd-4545977df7cc tempest-VolumesGetTest-1433751156 None] Deleted volume successfully. Jul 03 01:11:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-72aeec6d-e74b-4e3f-a4fd-4545977df7cc tempest-VolumesGetTest-1433751156 None] Lock "cinder-cd2661a0-58c5-42c1-a411-7912387001a7-delete_volume" released by "delete_volume" :: held 3.366s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:47 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c3a378c2-6053-4e2a-9cd6-d048ac2e5edb tempest-GroupSnapshotsV319Test-749322682 None] GroupSnapshot d661b416-f6b7-4fbb-9859-f1ae9dd3f38b: creating. Jul 03 01:11:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c3a378c2-6053-4e2a-9cd6-d048ac2e5edb tempest-GroupSnapshotsV319Test-749322682 None] Group snapshot d661b416-f6b7-4fbb-9859-f1ae9dd3f38b: creating. {{(pid=86772) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 01:11:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c3a378c2-6053-4e2a-9cd6-d048ac2e5edb tempest-GroupSnapshotsV319Test-749322682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:47 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ed1c095f-2860-48e6-80f5-1a6a98ebdb19 1073741824" returned: 0 in 1.109s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ed1c095f-2860-48e6-80f5-1a6a98ebdb19 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:47 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ed1c095f-2860-48e6-80f5-1a6a98ebdb19 Jul 03 01:11:47 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:47 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:11:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Flow 'volume_create_manager' (9e37845f-46bf-42d2-ab8a-8a8e1f047ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ee8e28-16af-4ccf-91f6-47a86c3bb38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ee8e28-16af-4ccf-91f6-47a86c3bb38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1706401671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43c7757-b60d-4859-ab65-1b85c528ed9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6354242950304d4ea09e1cd99a0a4c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:48Z,use_quota=True,user_id='fef647283c8f44fe9bd38698c904df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5251bcbf-05b6-42d2-a634-f15f70d4953a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5251bcbf-05b6-42d2-a634-f15f70d4953a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cd75337-a432-4cab-8b2a-32edf536fb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cd75337-a432-4cab-8b2a-32edf536fb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b43c7757-b60d-4859-ab65-1b85c528ed9e', 'volume_name': 'volume-b43c7757-b60d-4859-ab65-1b85c528ed9e', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a1363e-69ae-46a7-9deb-c336931419f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a1363e-69ae-46a7-9deb-c336931419f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90eb082-0fb4-4e7e-b794-5afaaec6ff3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:47 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Volume b43c7757-b60d-4859-ab65-1b85c528ed9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b43c7757-b60d-4859-ab65-1b85c528ed9e', 'volume_size': 1} Jul 03 01:11:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:48 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ed1c095f-2860-48e6-80f5-1a6a98ebdb19" returned: 0 in 0.671s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:11:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c3a378c2-6053-4e2a-9cd6-d048ac2e5edb tempest-GroupSnapshotsV319Test-749322682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.992s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69e50d3-0775-4e5e-8171-f853e7cbc280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed1c095f-2860-48e6-80f5-1a6a98ebdb19', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e1758c-00a5-42ad-8ab0-491fa958f8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-c3a378c2-6053-4e2a-9cd6-d048ac2e5edb tempest-GroupSnapshotsV319Test-749322682 None] Creating offline snapshot 2631a717-7c55-4326-ad05-537e0868e814 of volume 9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:11:48 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Volume volume-ed1c095f-2860-48e6-80f5-1a6a98ebdb19 (ed1c095f-2860-48e6-80f5-1a6a98ebdb19): created successfully Jul 03 01:11:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e1758c-00a5-42ad-8ab0-491fa958f8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Flow 'volume_create_manager' (374b9a0e-cd83-46d1-9816-dd46fef8fc0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:48 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af44a94-00db-4be0-af59-7f1f34bd1887]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c3a378c2-6053-4e2a-9cd6-d048ac2e5edb tempest-GroupSnapshotsV319Test-749322682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:48 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e83220b0-9d5a-4e04-acc4-721ac7467085 tempest-VolumesNegativeTest-1275720294 None] Created volume successfully. Jul 03 01:11:48 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7 Jul 03 01:11:48 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:49 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c3a378c2-6053-4e2a-9cd6-d048ac2e5edb tempest-GroupSnapshotsV319Test-749322682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7" returned: 0 in 0.758s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c3a378c2-6053-4e2a-9cd6-d048ac2e5edb tempest-GroupSnapshotsV319Test-749322682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.2631a717-7c55-4326-ad05-537e0868e814 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:49 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.2631a717-7c55-4326-ad05-537e0868e814 1G Jul 03 01:11:49 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:50 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c3a378c2-6053-4e2a-9cd6-d048ac2e5edb tempest-GroupSnapshotsV319Test-749322682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.2631a717-7c55-4326-ad05-537e0868e814 1G" returned: 0 in 0.911s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c3a378c2-6053-4e2a-9cd6-d048ac2e5edb tempest-GroupSnapshotsV319Test-749322682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.2631a717-7c55-4326-ad05-537e0868e814 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:50 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.2631a717-7c55-4326-ad05-537e0868e814 Jul 03 01:11:50 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:50 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c3a378c2-6053-4e2a-9cd6-d048ac2e5edb tempest-GroupSnapshotsV319Test-749322682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.2631a717-7c55-4326-ad05-537e0868e814" returned: 0 in 0.767s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:50 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-c3a378c2-6053-4e2a-9cd6-d048ac2e5edb tempest-GroupSnapshotsV319Test-749322682 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.2631a717-7c55-4326-ad05-537e0868e814 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:11:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c3a378c2-6053-4e2a-9cd6-d048ac2e5edb tempest-GroupSnapshotsV319Test-749322682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.2631a717-7c55-4326-ad05-537e0868e814 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:50 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.2631a717-7c55-4326-ad05-537e0868e814 Jul 03 01:11:50 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:51 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c3a378c2-6053-4e2a-9cd6-d048ac2e5edb tempest-GroupSnapshotsV319Test-749322682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.2631a717-7c55-4326-ad05-537e0868e814" returned: 0 in 0.640s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c3a378c2-6053-4e2a-9cd6-d048ac2e5edb tempest-GroupSnapshotsV319Test-749322682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:51 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.info Jul 03 01:11:51 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:52 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c3a378c2-6053-4e2a-9cd6-d048ac2e5edb tempest-GroupSnapshotsV319Test-749322682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.info" returned: 0 in 0.706s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:52 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-c3a378c2-6053-4e2a-9cd6-d048ac2e5edb tempest-GroupSnapshotsV319Test-749322682 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:11:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c3a378c2-6053-4e2a-9cd6-d048ac2e5edb tempest-GroupSnapshotsV319Test-749322682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:52 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.info Jul 03 01:11:52 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:52 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c3a378c2-6053-4e2a-9cd6-d048ac2e5edb tempest-GroupSnapshotsV319Test-749322682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.info" returned: 0 in 0.677s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c3a378c2-6053-4e2a-9cd6-d048ac2e5edb tempest-GroupSnapshotsV319Test-749322682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.583s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.062s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1706401671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43c7757-b60d-4859-ab65-1b85c528ed9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6354242950304d4ea09e1cd99a0a4c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:48Z,use_quota=True,user_id='fef647283c8f44fe9bd38698c904df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:11:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Creating volume b43c7757-b60d-4859-ab65-1b85c528ed9e {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:11:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:11:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:11:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:11:52 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:11:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:52 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e 1073741824 Jul 03 01:11:52 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:52 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c3a378c2-6053-4e2a-9cd6-d048ac2e5edb tempest-GroupSnapshotsV319Test-749322682 None] group_snapshot d661b416-f6b7-4fbb-9859-f1ae9dd3f38b: created successfully Jul 03 01:11:53 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e 1073741824" returned: 0 in 0.882s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:53 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e Jul 03 01:11:53 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:54 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-40485ed5-d9f2-4ebd-9f71-8ab46a974ab9 tempest-GroupSnapshotsV319Test-749322682 None] group_snapshot d661b416-f6b7-4fbb-9859-f1ae9dd3f38b: deleting Jul 03 01:11:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-40485ed5-d9f2-4ebd-9f71-8ab46a974ab9 tempest-GroupSnapshotsV319Test-749322682 None] group_snapshot d661b416-f6b7-4fbb-9859-f1ae9dd3f38b: deleting {{(pid=86772) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 01:11:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-40485ed5-d9f2-4ebd-9f71-8ab46a974ab9 tempest-GroupSnapshotsV319Test-749322682 None] Acquiring lock "cinder-quobyte-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-40485ed5-d9f2-4ebd-9f71-8ab46a974ab9 tempest-GroupSnapshotsV319Test-749322682 None] Lock "cinder-quobyte-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-40485ed5-d9f2-4ebd-9f71-8ab46a974ab9 tempest-GroupSnapshotsV319Test-749322682 None] Acquiring lock "cinder-quobyte-2631a717-7c55-4326-ad05-537e0868e814" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-40485ed5-d9f2-4ebd-9f71-8ab46a974ab9 tempest-GroupSnapshotsV319Test-749322682 None] Lock "cinder-quobyte-2631a717-7c55-4326-ad05-537e0868e814" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-40485ed5-d9f2-4ebd-9f71-8ab46a974ab9 tempest-GroupSnapshotsV319Test-749322682 None] Deleting offline snapshot 2631a717-7c55-4326-ad05-537e0868e814 of volume 9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:11:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-40485ed5-d9f2-4ebd-9f71-8ab46a974ab9 tempest-GroupSnapshotsV319Test-749322682 None] snapshot_file for this snap is: volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.2631a717-7c55-4326-ad05-537e0868e814 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:11:54 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3c6070-5349-493b-bc2d-efac014563ea]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-40485ed5-d9f2-4ebd-9f71-8ab46a974ab9 tempest-GroupSnapshotsV319Test-749322682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.2631a717-7c55-4326-ad05-537e0868e814 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:54 devstack sudo[97034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.2631a717-7c55-4326-ad05-537e0868e814 Jul 03 01:11:54 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:54 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e" returned: 0 in 0.742s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:11:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:11:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90eb082-0fb4-4e7e-b794-5afaaec6ff3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b43c7757-b60d-4859-ab65-1b85c528ed9e', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19569367-e241-4d4e-8000-db0fe034928e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:54 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Volume volume-b43c7757-b60d-4859-ab65-1b85c528ed9e (b43c7757-b60d-4859-ab65-1b85c528ed9e): created successfully Jul 03 01:11:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19569367-e241-4d4e-8000-db0fe034928e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Flow 'volume_create_manager' (9e37845f-46bf-42d2-ab8a-8a8e1f047ee3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:54 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-793fdfda-de32-45a6-82c7-95f4b4d2e005 tempest-VolumesGetTest-1433751156 None] Created volume successfully. Jul 03 01:11:55 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-40485ed5-d9f2-4ebd-9f71-8ab46a974ab9 tempest-GroupSnapshotsV319Test-749322682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.2631a717-7c55-4326-ad05-537e0868e814" returned: 0 in 0.841s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-40485ed5-d9f2-4ebd-9f71-8ab46a974ab9 tempest-GroupSnapshotsV319Test-749322682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:11:55 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfe1bd1-5374-4b86-a8c5-5c36f6a34576]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-40485ed5-d9f2-4ebd-9f71-8ab46a974ab9 tempest-GroupSnapshotsV319Test-749322682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:55 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7 Jul 03 01:11:55 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:55 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:11:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Flow 'volume_create_manager' (52158d64-620a-4e1c-9aa1-441f1519a58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:11:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477d3649-cbbc-4af2-8fa3-37478c94169a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477d3649-cbbc-4af2-8fa3-37478c94169a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1548192304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6354242950304d4ea09e1cd99a0a4c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b43c7757-b60d-4859-ab65-1b85c528ed9e,status='creating',terminated_at=None,updated_at=2026-07-02T23:11:56Z,use_quota=True,user_id='fef647283c8f44fe9bd38698c904df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69bfc568-414a-4128-aa84-d29c5cf7c726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69bfc568-414a-4128-aa84-d29c5cf7c726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6480f03e-3db1-453a-b647-3feabd1bfe72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6480f03e-3db1-453a-b647-3feabd1bfe72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67', 'volume_name': 'volume-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67', 'volume_size': 1, 'source_volid': 'b43c7757-b60d-4859-ab65-1b85c528ed9e', 'source_volstatus': 'available'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c437edc-fbbc-406a-a261-2efc6406e74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c437edc-fbbc-406a-a261-2efc6406e74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:11:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eef744a-2d46-4848-913c-16081162bf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:11:56 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Volume ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67', 'volume_size': 1, 'source_volid': 'b43c7757-b60d-4859-ab65-1b85c528ed9e', 'source_volstatus': 'available'} Jul 03 01:11:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:11:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:11:56 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Cloning volume b43c7757-b60d-4859-ab65-1b85c528ed9e to volume ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67 Jul 03 01:11:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Creating offline snapshot 7436e143-a6d1-4401-9ac1-b00282207531 of volume b43c7757-b60d-4859-ab65-1b85c528ed9e {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:11:56 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a468b1e-b265-4817-9e28-36db0eb9a597]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:56 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-40485ed5-d9f2-4ebd-9f71-8ab46a974ab9 tempest-GroupSnapshotsV319Test-749322682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7" returned: 0 in 1.190s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-40485ed5-d9f2-4ebd-9f71-8ab46a974ab9 tempest-GroupSnapshotsV319Test-749322682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.2631a717-7c55-4326-ad05-537e0868e814 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:56 devstack sudo[97047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.2631a717-7c55-4326-ad05-537e0868e814 Jul 03 01:11:56 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:56 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e Jul 03 01:11:56 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:57 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e" returned: 0 in 1.074s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.7436e143-a6d1-4401-9ac1-b00282207531 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:57 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-40485ed5-d9f2-4ebd-9f71-8ab46a974ab9 tempest-GroupSnapshotsV319Test-749322682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.2631a717-7c55-4326-ad05-537e0868e814" returned: 0 in 1.017s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-40485ed5-d9f2-4ebd-9f71-8ab46a974ab9 tempest-GroupSnapshotsV319Test-749322682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.2631a717-7c55-4326-ad05-537e0868e814 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:57 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.7436e143-a6d1-4401-9ac1-b00282207531 1G Jul 03 01:11:57 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:57 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.2631a717-7c55-4326-ad05-537e0868e814 Jul 03 01:11:57 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:58 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-40485ed5-d9f2-4ebd-9f71-8ab46a974ab9 tempest-GroupSnapshotsV319Test-749322682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7.2631a717-7c55-4326-ad05-537e0868e814" returned: 0 in 0.885s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-40485ed5-d9f2-4ebd-9f71-8ab46a974ab9 tempest-GroupSnapshotsV319Test-749322682 None] Lock "cinder-quobyte-2631a717-7c55-4326-ad05-537e0868e814" released by "_delete_snapshot" :: held 4.058s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-40485ed5-d9f2-4ebd-9f71-8ab46a974ab9 tempest-GroupSnapshotsV319Test-749322682 None] Lock "cinder-quobyte-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7" released by "delete_snapshot" :: held 4.084s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:11:58 devstack cinder-volume[86772]: WARNING cinder.quota [None req-40485ed5-d9f2-4ebd-9f71-8ab46a974ab9 tempest-GroupSnapshotsV319Test-749322682 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1932431088 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1932431088, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:11:58 devstack cinder-volume[86772]: WARNING cinder.quota [None req-40485ed5-d9f2-4ebd-9f71-8ab46a974ab9 tempest-GroupSnapshotsV319Test-749322682 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1932431088 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1932431088, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:11:58 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.7436e143-a6d1-4401-9ac1-b00282207531 1G" returned: 0 in 1.057s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:58 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-40485ed5-d9f2-4ebd-9f71-8ab46a974ab9 tempest-GroupSnapshotsV319Test-749322682 None] Created reservations ['31a5c164-9075-40a6-807d-a67b1da2a048', '7451b49e-cd18-469e-bbb2-26f161e09d35', 'b8bf9896-e9cf-4135-b2b9-e34273a6ec29', '874866df-161f-4416-aa41-6d223a3782ee'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:11:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b43c7757-b60d-4859-ab65-1b85c528ed9e -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.7436e143-a6d1-4401-9ac1-b00282207531 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:58 devstack sudo[97085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b43c7757-b60d-4859-ab65-1b85c528ed9e -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.7436e143-a6d1-4401-9ac1-b00282207531 Jul 03 01:11:58 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:58 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-40485ed5-d9f2-4ebd-9f71-8ab46a974ab9 tempest-GroupSnapshotsV319Test-749322682 None] group_snapshot d661b416-f6b7-4fbb-9859-f1ae9dd3f38b: deleted successfully Jul 03 01:11:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-90fac4cc-ea3a-426d-af75-3f0f228dfe56 tempest-GroupSnapshotsV319Test-749322682 None] Acquiring lock "cinder-quobyte-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:11:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-90fac4cc-ea3a-426d-af75-3f0f228dfe56 tempest-GroupSnapshotsV319Test-749322682 None] Lock "cinder-quobyte-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7" acquired by "delete_volume" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:11:59 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70ae5e8-f814-48d3-9dbe-cc147f60127b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:11:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-90fac4cc-ea3a-426d-af75-3f0f228dfe56 tempest-GroupSnapshotsV319Test-749322682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:59 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7 Jul 03 01:11:59 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:59 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b43c7757-b60d-4859-ab65-1b85c528ed9e -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.7436e143-a6d1-4401-9ac1-b00282207531" returned: 0 in 0.844s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:59 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.7436e143-a6d1-4401-9ac1-b00282207531 is being set with open permissions: ugo+rw Jul 03 01:11:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.7436e143-a6d1-4401-9ac1-b00282207531 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:59 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.7436e143-a6d1-4401-9ac1-b00282207531 Jul 03 01:11:59 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:59 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Jul 03 01:11:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-90fac4cc-ea3a-426d-af75-3f0f228dfe56 tempest-GroupSnapshotsV319Test-749322682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7" returned: 0 in 0.902s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:11:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-90fac4cc-ea3a-426d-af75-3f0f228dfe56 tempest-GroupSnapshotsV319Test-749322682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:11:59 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7 Jul 03 01:11:59 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:11:59 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.7436e143-a6d1-4401-9ac1-b00282207531" returned: 0 in 0.800s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:00 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.info Jul 03 01:12:00 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:00 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-90fac4cc-ea3a-426d-af75-3f0f228dfe56 tempest-GroupSnapshotsV319Test-749322682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7" returned: 0 in 0.789s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-90fac4cc-ea3a-426d-af75-3f0f228dfe56 tempest-GroupSnapshotsV319Test-749322682 None] Lock "cinder-quobyte-9c5b8dfe-2dd2-4cba-96b0-b96c3afe2cd7" released by "delete_volume" :: held 1.780s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:00 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.info" returned: 0 in 0.747s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:00 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.info is being set with open permissions: ugo+rw Jul 03 01:12:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:00 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.info Jul 03 01:12:00 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:00 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-90fac4cc-ea3a-426d-af75-3f0f228dfe56 tempest-GroupSnapshotsV319Test-749322682 None] Created reservations ['1bf12482-e63f-4120-acd7-53e7dc15c5b1'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:12:00 devstack cinder-volume[86772]: WARNING cinder.quota [None req-90fac4cc-ea3a-426d-af75-3f0f228dfe56 tempest-GroupSnapshotsV319Test-749322682 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1932431088 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1932431088, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:12:00 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-90fac4cc-ea3a-426d-af75-3f0f228dfe56 tempest-GroupSnapshotsV319Test-749322682 None] Created reservations ['28accd40-78c9-45fe-a823-a31f081b46cd', '163cd539-e613-4e7a-ab7f-23e589eb7507', '3a6cc181-4086-4c50-95de-167f81049b75', '42f148a8-6f0d-46d4-94fc-1544c3ca70f1'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:12:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-90fac4cc-ea3a-426d-af75-3f0f228dfe56 tempest-GroupSnapshotsV319Test-749322682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-90fac4cc-ea3a-426d-af75-3f0f228dfe56 tempest-GroupSnapshotsV319Test-749322682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-90fac4cc-ea3a-426d-af75-3f0f228dfe56 tempest-GroupSnapshotsV319Test-749322682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-90fac4cc-ea3a-426d-af75-3f0f228dfe56 tempest-GroupSnapshotsV319Test-749322682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-90fac4cc-ea3a-426d-af75-3f0f228dfe56 tempest-GroupSnapshotsV319Test-749322682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-90fac4cc-ea3a-426d-af75-3f0f228dfe56 tempest-GroupSnapshotsV319Test-749322682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:01 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:12:01 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:01 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.info" returned: 0 in 0.795s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Acquiring lock "cinder-quobyte-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67" by "_copy_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-b4878394-ef9c-41fd-91e5-b45ea048978b req-aca91893-43c0-40a6-9374-e1f78198f7f0 tempest-AttachVolumeTestJSON-1781287949 None] Terminate volume connection completed successfully. Jul 03 01:12:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-b4878394-ef9c-41fd-91e5-b45ea048978b req-aca91893-43c0-40a6-9374-e1f78198f7f0 tempest-AttachVolumeTestJSON-1781287949 None] Deleting attachment acddc171-8af5-4767-8c48-6e1da69dd63e. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:12:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Lock "cinder-quobyte-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] snapshot: 7436e143-a6d1-4401-9ac1-b00282207531, volume: ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67, {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 01:12:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:01 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[348309ba-f2a9-403c-ad76-9927d38b0d89]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.7436e143-a6d1-4401-9ac1-b00282207531 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:01 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.7436e143-a6d1-4401-9ac1-b00282207531 Jul 03 01:12:01 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:01 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-90fac4cc-ea3a-426d-af75-3f0f228dfe56 tempest-GroupSnapshotsV319Test-749322682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.876s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:01 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-90fac4cc-ea3a-426d-af75-3f0f228dfe56 tempest-GroupSnapshotsV319Test-749322682 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:12:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-90fac4cc-ea3a-426d-af75-3f0f228dfe56 tempest-GroupSnapshotsV319Test-749322682 None] Delete group completed successfully. Jul 03 01:12:03 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.7436e143-a6d1-4401-9ac1-b00282207531" returned: 0 in 1.379s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b43c7757-b60d-4859-ab65-1b85c528ed9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:12:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 01:12:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Creating direct copy from snapshot {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 01:12:03 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[350ba946-4c8f-474e-bf12-31ec49d1e013]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:03 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e Jul 03 01:12:03 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:04 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e" returned: 0 in 1.620s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:04 devstack cinder-volume[86772]: DEBUG cinder.utils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Path /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67 not found in is_blk_device check {{(pid=86772) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 01:12:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:04 devstack sudo[97236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67 Jul 03 01:12:04 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:11 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=98,cinder:UPDATE=143,cinder:INSERT=36,cinder:DELETE=14 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:12:11 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=137,cinder:SELECT=115,cinder:DELETE=9,cinder:INSERT=29 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:12:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:12:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:12 devstack sudo[97345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:12:12 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:13 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67" returned: 0 in 8.872s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:13 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe99c4dd-7ae9-413b-9b50-a3f1f80e863b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:13 devstack sudo[97350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e Jul 03 01:12:13 devstack sudo[97350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:13 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.099s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:12:14 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:12:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:12:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:12:14 devstack sudo[97350]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e" returned: 0 in 1.053s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:14 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Image conversion details: src /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e, size 1024.00 MB, duration 8.88 sec, destination /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67 {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:12:14 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Converted 1024.00 MB image at 115.37 MB/s Jul 03 01:12:14 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67 is being set with open permissions: ugo+rw Jul 03 01:12:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:14 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67 Jul 03 01:12:14 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:15 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67" returned: 0 in 0.731s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Lock "cinder-quobyte-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67" released by "_copy_volume_from_snapshot" :: held 13.809s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Acquiring lock "cinder-quobyte-7436e143-a6d1-4401-9ac1-b00282207531" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Lock "cinder-quobyte-7436e143-a6d1-4401-9ac1-b00282207531" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Deleting offline snapshot 7436e143-a6d1-4401-9ac1-b00282207531 of volume b43c7757-b60d-4859-ab65-1b85c528ed9e {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:12:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] snapshot_file for this snap is: volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.7436e143-a6d1-4401-9ac1-b00282207531 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:12:15 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdc600d-781b-4677-a0d8-56c678d559ee]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.7436e143-a6d1-4401-9ac1-b00282207531 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:15 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.7436e143-a6d1-4401-9ac1-b00282207531 Jul 03 01:12:15 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:16 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.7436e143-a6d1-4401-9ac1-b00282207531" returned: 0 in 0.929s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b43c7757-b60d-4859-ab65-1b85c528ed9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:12:16 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa03870-b3a5-424a-bbbe-3d6e63ddc7b8]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:16 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e Jul 03 01:12:16 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:17 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e" returned: 0 in 1.027s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.7436e143-a6d1-4401-9ac1-b00282207531 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:17 devstack sudo[97379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.7436e143-a6d1-4401-9ac1-b00282207531 Jul 03 01:12:17 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:18 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.7436e143-a6d1-4401-9ac1-b00282207531" returned: 0 in 0.944s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.7436e143-a6d1-4401-9ac1-b00282207531 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:18 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.7436e143-a6d1-4401-9ac1-b00282207531 Jul 03 01:12:18 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:19 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e.7436e143-a6d1-4401-9ac1-b00282207531" returned: 0 in 1.337s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Lock "cinder-quobyte-7436e143-a6d1-4401-9ac1-b00282207531" released by "_delete_snapshot" :: held 4.383s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 23.829s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eef744a-2d46-4848-913c-16081162bf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67', 'volume_size': 1, 'source_volid': 'b43c7757-b60d-4859-ab65-1b85c528ed9e', 'source_volstatus': 'available'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63be76e5-63a7-44a7-8d78-938e1fd3d09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:20 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Volume volume-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67 (ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67): created successfully Jul 03 01:12:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63be76e5-63a7-44a7-8d78-938e1fd3d09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Flow 'volume_create_manager' (52158d64-620a-4e1c-9aa1-441f1519a58d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:20 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f647826a-c339-435d-a7e4-23abd4fd2585 tempest-VolumesGetTest-1433751156 None] Created volume successfully. Jul 03 01:12:21 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c9c764b4-32c0-48d3-97fa-bf3cd06e13ce tempest-GroupsV320Test-211545823 None] Group tempest-GroupsV320Test-Group-1337473142: creating Jul 03 01:12:21 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c9c764b4-32c0-48d3-97fa-bf3cd06e13ce tempest-GroupsV320Test-211545823 None] Group tempest-GroupsV320Test-Group-1337473142: created successfully Jul 03 01:12:21 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c9c764b4-32c0-48d3-97fa-bf3cd06e13ce tempest-GroupsV320Test-211545823 None] Create group completed successfully. Jul 03 01:12:22 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:12:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Flow 'volume_create_manager' (52434c0f-b77a-4aa0-8f92-6dafd7a7765e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6c0a298-e9fe-498f-b441-b1bd156a7bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6c0a298-e9fe-498f-b441-b1bd156a7bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1237605187',display_name='tempest-VolumesGetTest-Volume-884896224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6354242950304d4ea09e1cd99a0a4c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:22Z,use_quota=True,user_id='fef647283c8f44fe9bd38698c904df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (635f210c-8fa0-438c-992c-89c091b38273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (635f210c-8fa0-438c-992c-89c091b38273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2863f31d-93b8-4ad3-bccc-6d3de40cf05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2863f31d-93b8-4ad3-bccc-6d3de40cf05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193', 'volume_name': 'volume-c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (837492e7-1ca3-4b84-9b4f-3192229b6a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (837492e7-1ca3-4b84-9b4f-3192229b6a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c5df3b-89ba-471a-bedd-d207d8e916c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:22 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Volume c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193', 'volume_size': 1} Jul 03 01:12:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1237605187',display_name='tempest-VolumesGetTest-Volume-884896224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6354242950304d4ea09e1cd99a0a4c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:22Z,use_quota=True,user_id='fef647283c8f44fe9bd38698c904df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:12:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Creating volume c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:12:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:12:22 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:12:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:22 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193 1073741824 Jul 03 01:12:22 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:23 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-8599a554-799e-4c10-a509-faef83d353a3 tempest-GroupsV320Test-211545823 None] Created reservations ['46f01471-01ac-4951-bb0c-92300bf787ce'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:12:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8599a554-799e-4c10-a509-faef83d353a3 tempest-GroupsV320Test-211545823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8599a554-799e-4c10-a509-faef83d353a3 tempest-GroupsV320Test-211545823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8599a554-799e-4c10-a509-faef83d353a3 tempest-GroupsV320Test-211545823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8599a554-799e-4c10-a509-faef83d353a3 tempest-GroupsV320Test-211545823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8599a554-799e-4c10-a509-faef83d353a3 tempest-GroupsV320Test-211545823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8599a554-799e-4c10-a509-faef83d353a3 tempest-GroupsV320Test-211545823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:23 devstack sudo[97472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:12:23 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:23 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193 1073741824" returned: 0 in 1.195s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:23 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193 Jul 03 01:12:23 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:24 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8599a554-799e-4c10-a509-faef83d353a3 tempest-GroupsV320Test-211545823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.746s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:24 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-8599a554-799e-4c10-a509-faef83d353a3 tempest-GroupsV320Test-211545823 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:12:24 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8599a554-799e-4c10-a509-faef83d353a3 tempest-GroupsV320Test-211545823 None] Delete group completed successfully. Jul 03 01:12:24 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193" returned: 0 in 0.790s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] <== create_volume: return (2053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:12:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.056s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c5df3b-89ba-471a-bedd-d207d8e916c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f358c570-a5ff-4be7-b6e0-162f576e269f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:24 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Volume volume-c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193 (c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193): created successfully Jul 03 01:12:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f358c570-a5ff-4be7-b6e0-162f576e269f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Flow 'volume_create_manager' (52434c0f-b77a-4aa0-8f92-6dafd7a7765e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:24 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1613d854-dbb4-4c2d-b4d7-00af5fc0d277 tempest-VolumesGetTest-1433751156 None] Created volume successfully. Jul 03 01:12:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d8cee060-349a-48ee-87f5-837af971e37d tempest-VolumesGetTest-1433751156 None] Acquiring lock "cinder-c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d8cee060-349a-48ee-87f5-837af971e37d tempest-VolumesGetTest-1433751156 None] Lock "cinder-c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d8cee060-349a-48ee-87f5-837af971e37d tempest-VolumesGetTest-1433751156 None] Acquiring lock "cinder-quobyte-c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d8cee060-349a-48ee-87f5-837af971e37d tempest-VolumesGetTest-1433751156 None] Lock "cinder-quobyte-c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193" acquired by "delete_volume" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:25 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d935c9-8c68-4495-92c7-1176130c5db6]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d8cee060-349a-48ee-87f5-837af971e37d tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:26 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193 Jul 03 01:12:26 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0c0ac442-3cef-4470-a0a4-566e5d5aae5c tempest-VolumesNegativeTest-1275720294 None] Acquiring lock "cinder-ed1c095f-2860-48e6-80f5-1a6a98ebdb19-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0c0ac442-3cef-4470-a0a4-566e5d5aae5c tempest-VolumesNegativeTest-1275720294 None] Lock "cinder-ed1c095f-2860-48e6-80f5-1a6a98ebdb19-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0c0ac442-3cef-4470-a0a4-566e5d5aae5c tempest-VolumesNegativeTest-1275720294 None] Acquiring lock "cinder-quobyte-ed1c095f-2860-48e6-80f5-1a6a98ebdb19" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0c0ac442-3cef-4470-a0a4-566e5d5aae5c tempest-VolumesNegativeTest-1275720294 None] Lock "cinder-quobyte-ed1c095f-2860-48e6-80f5-1a6a98ebdb19" acquired by "delete_volume" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:26 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5196eb-3546-4392-b8c2-3f8b4ab9e37d]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0c0ac442-3cef-4470-a0a4-566e5d5aae5c tempest-VolumesNegativeTest-1275720294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ed1c095f-2860-48e6-80f5-1a6a98ebdb19 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:27 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ed1c095f-2860-48e6-80f5-1a6a98ebdb19 Jul 03 01:12:27 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:27 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d8cee060-349a-48ee-87f5-837af971e37d tempest-VolumesGetTest-1433751156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193" returned: 0 in 1.342s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d8cee060-349a-48ee-87f5-837af971e37d tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:27 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193 Jul 03 01:12:27 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:28 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0c0ac442-3cef-4470-a0a4-566e5d5aae5c tempest-VolumesNegativeTest-1275720294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ed1c095f-2860-48e6-80f5-1a6a98ebdb19" returned: 0 in 1.341s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0c0ac442-3cef-4470-a0a4-566e5d5aae5c tempest-VolumesNegativeTest-1275720294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ed1c095f-2860-48e6-80f5-1a6a98ebdb19 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:28 devstack sudo[97497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ed1c095f-2860-48e6-80f5-1a6a98ebdb19 Jul 03 01:12:28 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:28 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d8cee060-349a-48ee-87f5-837af971e37d tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193" returned: 0 in 0.921s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d8cee060-349a-48ee-87f5-837af971e37d tempest-VolumesGetTest-1433751156 None] Lock "cinder-quobyte-c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193" released by "delete_volume" :: held 2.336s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:28 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-d8cee060-349a-48ee-87f5-837af971e37d tempest-VolumesGetTest-1433751156 None] Created reservations ['d55f3d28-3e37-4cd1-be5d-24ac007acf7a', '42ed8ada-d22e-4f29-9948-ab6118a65a21', 'f06cf020-d582-4558-b91e-1c3878937a98', 'e44dd28a-94cb-421d-9064-49efc1bc5326'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:12:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d8cee060-349a-48ee-87f5-837af971e37d tempest-VolumesGetTest-1433751156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d8cee060-349a-48ee-87f5-837af971e37d tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d8cee060-349a-48ee-87f5-837af971e37d tempest-VolumesGetTest-1433751156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d8cee060-349a-48ee-87f5-837af971e37d tempest-VolumesGetTest-1433751156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d8cee060-349a-48ee-87f5-837af971e37d tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d8cee060-349a-48ee-87f5-837af971e37d tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:28 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:12:28 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:29 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0c0ac442-3cef-4470-a0a4-566e5d5aae5c tempest-VolumesNegativeTest-1275720294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ed1c095f-2860-48e6-80f5-1a6a98ebdb19" returned: 0 in 1.002s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0c0ac442-3cef-4470-a0a4-566e5d5aae5c tempest-VolumesNegativeTest-1275720294 None] Lock "cinder-quobyte-ed1c095f-2860-48e6-80f5-1a6a98ebdb19" released by "delete_volume" :: held 2.407s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:29 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-0c0ac442-3cef-4470-a0a4-566e5d5aae5c tempest-VolumesNegativeTest-1275720294 None] Created reservations ['d798343e-442f-4870-9bdb-6f0017707ecc', '150450ff-1ef8-4800-9525-4be3424172ef', 'ce4d0e1f-a8f5-4926-9a41-7103ebb2a5c4', 'cf55fc40-b228-4229-9f8e-6738fe393199'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:12:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0c0ac442-3cef-4470-a0a4-566e5d5aae5c tempest-VolumesNegativeTest-1275720294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0c0ac442-3cef-4470-a0a4-566e5d5aae5c tempest-VolumesNegativeTest-1275720294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0c0ac442-3cef-4470-a0a4-566e5d5aae5c tempest-VolumesNegativeTest-1275720294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0c0ac442-3cef-4470-a0a4-566e5d5aae5c tempest-VolumesNegativeTest-1275720294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0c0ac442-3cef-4470-a0a4-566e5d5aae5c tempest-VolumesNegativeTest-1275720294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0c0ac442-3cef-4470-a0a4-566e5d5aae5c tempest-VolumesNegativeTest-1275720294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b7e0223e-b4ba-4739-b294-72c4d772b008 tempest-VolumesGetTest-1433751156 None] Acquiring lock "cinder-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:29 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:12:29 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b7e0223e-b4ba-4739-b294-72c4d772b008 tempest-VolumesGetTest-1433751156 None] Lock "cinder-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b7e0223e-b4ba-4739-b294-72c4d772b008 tempest-VolumesGetTest-1433751156 None] Acquiring lock "cinder-quobyte-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b7e0223e-b4ba-4739-b294-72c4d772b008 tempest-VolumesGetTest-1433751156 None] Lock "cinder-quobyte-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67" acquired by "delete_volume" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:29 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e67d36-68e7-4cf4-ae6b-9014015db46b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b7e0223e-b4ba-4739-b294-72c4d772b008 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:29 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d8cee060-349a-48ee-87f5-837af971e37d tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.141s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:29 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-d8cee060-349a-48ee-87f5-837af971e37d tempest-VolumesGetTest-1433751156 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:12:29 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d8cee060-349a-48ee-87f5-837af971e37d tempest-VolumesGetTest-1433751156 None] Deleted volume successfully. Jul 03 01:12:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d8cee060-349a-48ee-87f5-837af971e37d tempest-VolumesGetTest-1433751156 None] Lock "cinder-c6c4e38c-d89b-4b8f-8ce0-51e7e73fe193-delete_volume" released by "delete_volume" :: held 3.824s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:29 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67 Jul 03 01:12:29 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:30 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0c0ac442-3cef-4470-a0a4-566e5d5aae5c tempest-VolumesNegativeTest-1275720294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.836s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:30 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-0c0ac442-3cef-4470-a0a4-566e5d5aae5c tempest-VolumesNegativeTest-1275720294 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:12:30 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-0c0ac442-3cef-4470-a0a4-566e5d5aae5c tempest-VolumesNegativeTest-1275720294 None] Deleted volume successfully. Jul 03 01:12:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0c0ac442-3cef-4470-a0a4-566e5d5aae5c tempest-VolumesNegativeTest-1275720294 None] Lock "cinder-ed1c095f-2860-48e6-80f5-1a6a98ebdb19-delete_volume" released by "delete_volume" :: held 3.526s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:30 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b7e0223e-b4ba-4739-b294-72c4d772b008 tempest-VolumesGetTest-1433751156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67" returned: 0 in 1.094s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b7e0223e-b4ba-4739-b294-72c4d772b008 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:30 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67 Jul 03 01:12:30 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:31 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b7e0223e-b4ba-4739-b294-72c4d772b008 tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67" returned: 0 in 0.901s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b7e0223e-b4ba-4739-b294-72c4d772b008 tempest-VolumesGetTest-1433751156 None] Lock "cinder-quobyte-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67" released by "delete_volume" :: held 2.051s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:31 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-b7e0223e-b4ba-4739-b294-72c4d772b008 tempest-VolumesGetTest-1433751156 None] Created reservations ['244aa700-e308-4d1b-bcd2-e596e70c63ec', 'd39765d8-d398-4758-83c5-5be0fa7732fc', '752eb2cb-611c-4b2f-b01e-60beb2fadd3b', '298ca7fb-86f1-43cb-9957-4b2302073186'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:12:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b7e0223e-b4ba-4739-b294-72c4d772b008 tempest-VolumesGetTest-1433751156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b7e0223e-b4ba-4739-b294-72c4d772b008 tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b7e0223e-b4ba-4739-b294-72c4d772b008 tempest-VolumesGetTest-1433751156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b7e0223e-b4ba-4739-b294-72c4d772b008 tempest-VolumesGetTest-1433751156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b7e0223e-b4ba-4739-b294-72c4d772b008 tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b7e0223e-b4ba-4739-b294-72c4d772b008 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:31 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:12:31 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:32 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b7e0223e-b4ba-4739-b294-72c4d772b008 tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.817s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:32 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-b7e0223e-b4ba-4739-b294-72c4d772b008 tempest-VolumesGetTest-1433751156 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:12:32 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b7e0223e-b4ba-4739-b294-72c4d772b008 tempest-VolumesGetTest-1433751156 None] Deleted volume successfully. Jul 03 01:12:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b7e0223e-b4ba-4739-b294-72c4d772b008 tempest-VolumesGetTest-1433751156 None] Lock "cinder-ca45be1a-38ff-4f5f-b9e4-42dd0bbc7d67-delete_volume" released by "delete_volume" :: held 3.157s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e2a0ab65-620a-4787-8a29-20f60e780ed8 tempest-VolumesGetTest-1433751156 None] Acquiring lock "cinder-b43c7757-b60d-4859-ab65-1b85c528ed9e-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e2a0ab65-620a-4787-8a29-20f60e780ed8 tempest-VolumesGetTest-1433751156 None] Lock "cinder-b43c7757-b60d-4859-ab65-1b85c528ed9e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e2a0ab65-620a-4787-8a29-20f60e780ed8 tempest-VolumesGetTest-1433751156 None] Acquiring lock "cinder-quobyte-b43c7757-b60d-4859-ab65-1b85c528ed9e" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e2a0ab65-620a-4787-8a29-20f60e780ed8 tempest-VolumesGetTest-1433751156 None] Lock "cinder-quobyte-b43c7757-b60d-4859-ab65-1b85c528ed9e" acquired by "delete_volume" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:33 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bece423-f7fa-4f33-a580-f77a81ffe0a7]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2a0ab65-620a-4787-8a29-20f60e780ed8 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:33 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e Jul 03 01:12:33 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:33 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:12:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Flow 'volume_create_manager' (c03651ec-52c6-46bc-86c6-7d8043e9f204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae08a9d3-ef45-41f5-bb4d-75920d61b662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae08a9d3-ef45-41f5-bb4d-75920d61b662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2080095272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa83f0261e44e8b9a220f04c003cd8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:34Z,use_quota=True,user_id='8ceb2623cfb04af0848f39e7cde9853c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec4d002-f912-4c69-892f-3a09acb870c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec4d002-f912-4c69-892f-3a09acb870c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22baf2d1-0cc5-42b2-8940-78913a4d6523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22baf2d1-0cc5-42b2-8940-78913a4d6523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92', 'volume_name': 'volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5db3cf-7ebf-4627-9262-7f3be7678fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5db3cf-7ebf-4627-9262-7f3be7678fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eb119d7-ae8f-4ba0-aca2-d7d4a5375df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:33 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Volume 3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92', 'volume_size': 1} Jul 03 01:12:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2080095272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa83f0261e44e8b9a220f04c003cd8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:34Z,use_quota=True,user_id='8ceb2623cfb04af0848f39e7cde9853c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:12:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Creating volume 3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:12:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:12:33 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:12:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:34 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:34 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92 1073741824 Jul 03 01:12:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2a0ab65-620a-4787-8a29-20f60e780ed8 tempest-VolumesGetTest-1433751156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e" returned: 0 in 0.952s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:34 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2a0ab65-620a-4787-8a29-20f60e780ed8 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:34 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e Jul 03 01:12:34 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:34 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2a0ab65-620a-4787-8a29-20f60e780ed8 tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b43c7757-b60d-4859-ab65-1b85c528ed9e" returned: 0 in 0.685s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e2a0ab65-620a-4787-8a29-20f60e780ed8 tempest-VolumesGetTest-1433751156 None] Lock "cinder-quobyte-b43c7757-b60d-4859-ab65-1b85c528ed9e" released by "delete_volume" :: held 1.709s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:34 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e2a0ab65-620a-4787-8a29-20f60e780ed8 tempest-VolumesGetTest-1433751156 None] Created reservations ['4b747af5-9400-4f15-8bf0-616320013ac5', '0babf693-aeed-4275-9b19-4a86eafc4cc5', '0c7406fb-4ea2-4364-9b58-2dcc0a04fcfa', 'acdcdf6e-6761-4f3d-b19a-c56440188858'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:12:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e2a0ab65-620a-4787-8a29-20f60e780ed8 tempest-VolumesGetTest-1433751156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e2a0ab65-620a-4787-8a29-20f60e780ed8 tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e2a0ab65-620a-4787-8a29-20f60e780ed8 tempest-VolumesGetTest-1433751156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e2a0ab65-620a-4787-8a29-20f60e780ed8 tempest-VolumesGetTest-1433751156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e2a0ab65-620a-4787-8a29-20f60e780ed8 tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2a0ab65-620a-4787-8a29-20f60e780ed8 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:34 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:12:34 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:35 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92 1073741824" returned: 0 in 1.101s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:35 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92 Jul 03 01:12:35 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:35 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2a0ab65-620a-4787-8a29-20f60e780ed8 tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.956s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:35 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-e2a0ab65-620a-4787-8a29-20f60e780ed8 tempest-VolumesGetTest-1433751156 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:12:35 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e2a0ab65-620a-4787-8a29-20f60e780ed8 tempest-VolumesGetTest-1433751156 None] Deleted volume successfully. Jul 03 01:12:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e2a0ab65-620a-4787-8a29-20f60e780ed8 tempest-VolumesGetTest-1433751156 None] Lock "cinder-b43c7757-b60d-4859-ab65-1b85c528ed9e-delete_volume" released by "delete_volume" :: held 2.993s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:36 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92" returned: 0 in 0.876s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] <== create_volume: return (2032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:12:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.035s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eb119d7-ae8f-4ba0-aca2-d7d4a5375df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (525c371b-ca2d-4795-b580-dcc6f4db59ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:36 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Volume volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92 (3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92): created successfully Jul 03 01:12:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (525c371b-ca2d-4795-b580-dcc6f4db59ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Flow 'volume_create_manager' (c03651ec-52c6-46bc-86c6-7d8043e9f204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:36 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-be0a50b3-d705-4cc1-aaf5-5c715b93037b tempest-VolumesSnapshotListTestJSON-959609686 None] Created volume successfully. Jul 03 01:12:36 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:12:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Flow 'volume_create_manager' (696abaf1-5b25-4373-82ae-91df2a2be167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb6ecbd-5e6b-4150-9434-2461ba1dc4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb6ecbd-5e6b-4150-9434-2461ba1dc4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-424850398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44128ad7-6fe9-4f97-a044-891e111be6ae,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6354242950304d4ea09e1cd99a0a4c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:36Z,use_quota=True,user_id='fef647283c8f44fe9bd38698c904df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f2ac93-e963-461f-bc59-cebe689efdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f2ac93-e963-461f-bc59-cebe689efdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d9336b-233e-4597-a47b-6c7b4480fed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:36 devstack cinder-volume[86772]: DEBUG cinder.image.glance [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Creating Keystone auth plugin from conf {{(pid=86772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 01:12:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d9336b-233e-4597-a47b-6c7b4480fed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '44128ad7-6fe9-4f97-a044-891e111be6ae', 'volume_name': 'volume-44128ad7-6fe9-4f97-a044-891e111be6ae', 'volume_size': 1, 'image_id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d536ca8-2cba-4b44-93ed-ed247e842444', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b88b4a33269476b9f6e11e7fe82fb87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'created_at': datetime.datetime(2026, 7, 2, 22, 56, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 56, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d536ca8-2cba-4b44-93ed-ed247e842444/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c10d34-07e4-442d-be95-e7f581e13aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c10d34-07e4-442d-be95-e7f581e13aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63656cb-2786-44b0-ac80-0fba22111978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:37 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Volume 44128ad7-6fe9-4f97-a044-891e111be6ae: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-44128ad7-6fe9-4f97-a044-891e111be6ae', 'volume_size': 1, 'image_id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d536ca8-2cba-4b44-93ed-ed247e842444', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b88b4a33269476b9f6e11e7fe82fb87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'created_at': datetime.datetime(2026, 7, 2, 22, 56, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 56, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d536ca8-2cba-4b44-93ed-ed247e842444/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 01:12:37 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Trying to clone 44128ad7-6fe9-4f97-a044-891e111be6ae from image 3d536ca8-2cba-4b44-93ed-ed247e842444 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3d536ca8-2cba-4b44-93ed-ed247e842444', 'metadata': {}}]). {{(pid=86772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 01:12:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d920c979-430c-4dae-84fd-ed3d0363d396 tempest-VolumesSnapshotListTestJSON-959609686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d920c979-430c-4dae-84fd-ed3d0363d396 tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-d920c979-430c-4dae-84fd-ed3d0363d396 tempest-VolumesSnapshotListTestJSON-959609686 None] Creating offline snapshot ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a of volume 3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:12:37 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f317d8a-303d-45ed-87e7-492c25a431fd]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d920c979-430c-4dae-84fd-ed3d0363d396 tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:37 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92 Jul 03 01:12:37 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:37 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_c7w2h916devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 01:12:37 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Image download 20.69 MB at 20.69 MB/s Jul 03 01:12:37 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a9b1a2-4f83-449d-9a69-d8524dc583f1]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_c7w2h916devstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:37 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_c7w2h916devstack@QuobyteHD Jul 03 01:12:37 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:38 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d920c979-430c-4dae-84fd-ed3d0363d396 tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92" returned: 0 in 0.905s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d920c979-430c-4dae-84fd-ed3d0363d396 tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:38 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a 1G Jul 03 01:12:38 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:38 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_c7w2h916devstack@QuobyteHD" returned: 0 in 0.869s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:38 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Temporary image 3d536ca8-2cba-4b44-93ed-ed247e842444 is fetched for user fef647283c8f44fe9bd38698c904df52. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 01:12:38 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb8aa70-4ca3-4134-b6a0-cf41dc2d1380]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_c7w2h916devstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:38 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_c7w2h916devstack@QuobyteHD Jul 03 01:12:38 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:39 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d920c979-430c-4dae-84fd-ed3d0363d396 tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a 1G" returned: 0 in 1.149s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d920c979-430c-4dae-84fd-ed3d0363d396 tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:39 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a Jul 03 01:12:39 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:39 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_c7w2h916devstack@QuobyteHD" returned: 0 in 0.919s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:40 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d920c979-430c-4dae-84fd-ed3d0363d396 tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a" returned: 0 in 0.730s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:40 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-d920c979-430c-4dae-84fd-ed3d0363d396 tempest-VolumesSnapshotListTestJSON-959609686 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a is being set with open permissions: ugo+rw Jul 03 01:12:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d920c979-430c-4dae-84fd-ed3d0363d396 tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:40 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a Jul 03 01:12:40 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:40 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:12:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Flow 'volume_create_manager' (a894d1d5-1e62-4878-b2b1-ed1d30adc203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d822769c-9a5f-4ac1-bfbc-38cbc88b992f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d822769c-9a5f-4ac1-bfbc-38cbc88b992f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-33190265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943ee3b4-7dd7-4034-ae9c-ec1f20b57d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3bb599f6564371a46a41f86fce86d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:41Z,use_quota=True,user_id='9ee6c32b4a4a41c2aa131192716b8ebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ace4d8-b1c7-46ba-ab10-f9681c987245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ace4d8-b1c7-46ba-ab10-f9681c987245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb616724-f4a0-4838-bc57-960c123e768d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb616724-f4a0-4838-bc57-960c123e768d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '943ee3b4-7dd7-4034-ae9c-ec1f20b57d39', 'volume_name': 'volume-943ee3b4-7dd7-4034-ae9c-ec1f20b57d39', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8792c834-efc4-4dc2-b8e9-12ca439c3cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8792c834-efc4-4dc2-b8e9-12ca439c3cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164b76e2-3962-4927-8b7b-d8e7d9ef628f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:40 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Volume 943ee3b4-7dd7-4034-ae9c-ec1f20b57d39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-943ee3b4-7dd7-4034-ae9c-ec1f20b57d39', 'volume_size': 1} Jul 03 01:12:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:40 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d920c979-430c-4dae-84fd-ed3d0363d396 tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a" returned: 0 in 0.662s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d920c979-430c-4dae-84fd-ed3d0363d396 tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:40 devstack sudo[97578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.info Jul 03 01:12:40 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:41 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d920c979-430c-4dae-84fd-ed3d0363d396 tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.info" returned: 0 in 0.666s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:41 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-d920c979-430c-4dae-84fd-ed3d0363d396 tempest-VolumesSnapshotListTestJSON-959609686 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.info is being set with open permissions: ugo+rw Jul 03 01:12:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d920c979-430c-4dae-84fd-ed3d0363d396 tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:41 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.info Jul 03 01:12:41 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:42 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d920c979-430c-4dae-84fd-ed3d0363d396 tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.info" returned: 0 in 0.700s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d920c979-430c-4dae-84fd-ed3d0363d396 tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.938s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.643s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-424850398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44128ad7-6fe9-4f97-a044-891e111be6ae,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6354242950304d4ea09e1cd99a0a4c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:36Z,use_quota=True,user_id='fef647283c8f44fe9bd38698c904df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:12:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Creating volume 44128ad7-6fe9-4f97-a044-891e111be6ae {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:12:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:12:42 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:12:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:42 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae 1073741824 Jul 03 01:12:42 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:42 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d920c979-430c-4dae-84fd-ed3d0363d396 tempest-VolumesSnapshotListTestJSON-959609686 None] Create snapshot completed successfully Jul 03 01:12:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5dbe3082-d9b3-4ec8-8c3d-028773efc631 tempest-VolumesSnapshotListTestJSON-959609686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:43 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae 1073741824" returned: 0 in 0.938s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:43 devstack sudo[97598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae Jul 03 01:12:43 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:44 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae" returned: 0 in 0.887s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:12:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.474s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-33190265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943ee3b4-7dd7-4034-ae9c-ec1f20b57d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3bb599f6564371a46a41f86fce86d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:41Z,use_quota=True,user_id='9ee6c32b4a4a41c2aa131192716b8ebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:12:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Creating volume 943ee3b4-7dd7-4034-ae9c-ec1f20b57d39 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:12:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:12:44 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:12:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-943ee3b4-7dd7-4034-ae9c-ec1f20b57d39 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:44 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Attempting download of 3d536ca8-2cba-4b44-93ed-ed247e842444 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d536ca8-2cba-4b44-93ed-ed247e842444', 'metadata': {}}])) to volume 44128ad7-6fe9-4f97-a044-891e111be6ae. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 01:12:44 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-943ee3b4-7dd7-4034-ae9c-ec1f20b57d39 1073741824 Jul 03 01:12:44 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:44 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[834fa26c-b487-4196-bc66-0ec24037df58]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_m3tqghoe {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:44 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_m3tqghoe Jul 03 01:12:44 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:45 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_m3tqghoe" returned: 0 in 0.802s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_m3tqghoe {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:45 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-943ee3b4-7dd7-4034-ae9c-ec1f20b57d39 1073741824" returned: 0 in 0.959s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-943ee3b4-7dd7-4034-ae9c-ec1f20b57d39 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:45 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_m3tqghoe Jul 03 01:12:45 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:45 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-943ee3b4-7dd7-4034-ae9c-ec1f20b57d39 Jul 03 01:12:45 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:45 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-943ee3b4-7dd7-4034-ae9c-ec1f20b57d39" returned: 0 in 0.748s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:12:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5dbe3082-d9b3-4ec8-8c3d-028773efc631 tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.174s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164b76e2-3962-4927-8b7b-d8e7d9ef628f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-943ee3b4-7dd7-4034-ae9c-ec1f20b57d39', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441e2aad-0488-46a0-8353-7366415a221e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-5dbe3082-d9b3-4ec8-8c3d-028773efc631 tempest-VolumesSnapshotListTestJSON-959609686 None] Creating offline snapshot 6aaff32b-f41f-41bf-969a-593c8bfcd546 of volume 3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:12:46 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Volume volume-943ee3b4-7dd7-4034-ae9c-ec1f20b57d39 (943ee3b4-7dd7-4034-ae9c-ec1f20b57d39): created successfully Jul 03 01:12:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441e2aad-0488-46a0-8353-7366415a221e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Flow 'volume_create_manager' (a894d1d5-1e62-4878-b2b1-ed1d30adc203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:46 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b259f9cd-ac1e-4606-bcde-2cd1b1c24004]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5dbe3082-d9b3-4ec8-8c3d-028773efc631 tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:46 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_m3tqghoe" returned: 1 in 0.998s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_m3tqghoe' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:12:46 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd044d41-d466-4b8f-a031-113e2dbabd8c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_c7w2h916devstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:46 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a2d42f0f-a453-4c36-a804-d92c5bb431ea tempest-VolumeQuotasAdminTestJSON-162463294 None] Created volume successfully. Jul 03 01:12:46 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a Jul 03 01:12:46 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:46 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_c7w2h916devstack@QuobyteHD Jul 03 01:12:46 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:46 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_c7w2h916devstack@QuobyteHD" returned: 0 in 0.755s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:46 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] 3d536ca8-2cba-4b44-93ed-ed247e842444 was qcow2, converting to raw {{(pid=86772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 01:12:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_c7w2h916devstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:46 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_c7w2h916devstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae Jul 03 01:12:46 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:46 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5dbe3082-d9b3-4ec8-8c3d-028773efc631 tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a" returned: 0 in 0.839s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-5dbe3082-d9b3-4ec8-8c3d-028773efc631 tempest-VolumesSnapshotListTestJSON-959609686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:12:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5dbe3082-d9b3-4ec8-8c3d-028773efc631 tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:46 devstack sudo[97667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546 1G Jul 03 01:12:46 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2cd49327-f1b1-485c-be61-ab72bc8783c4 tempest-VolumeQuotasAdminTestJSON-162463294 None] Acquiring lock "cinder-943ee3b4-7dd7-4034-ae9c-ec1f20b57d39-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2cd49327-f1b1-485c-be61-ab72bc8783c4 tempest-VolumeQuotasAdminTestJSON-162463294 None] Lock "cinder-943ee3b4-7dd7-4034-ae9c-ec1f20b57d39-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2cd49327-f1b1-485c-be61-ab72bc8783c4 tempest-VolumeQuotasAdminTestJSON-162463294 None] Acquiring lock "cinder-quobyte-943ee3b4-7dd7-4034-ae9c-ec1f20b57d39" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2cd49327-f1b1-485c-be61-ab72bc8783c4 tempest-VolumeQuotasAdminTestJSON-162463294 None] Lock "cinder-quobyte-943ee3b4-7dd7-4034-ae9c-ec1f20b57d39" acquired by "delete_volume" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:47 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c00302-bf2c-40f7-b7f2-4643868a18a4]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2cd49327-f1b1-485c-be61-ab72bc8783c4 tempest-VolumeQuotasAdminTestJSON-162463294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-943ee3b4-7dd7-4034-ae9c-ec1f20b57d39 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:47 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-943ee3b4-7dd7-4034-ae9c-ec1f20b57d39 Jul 03 01:12:47 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:47 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5dbe3082-d9b3-4ec8-8c3d-028773efc631 tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546 1G" returned: 0 in 1.078s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5dbe3082-d9b3-4ec8-8c3d-028773efc631 tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:47 devstack sudo[97686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546 Jul 03 01:12:47 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:48 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2cd49327-f1b1-485c-be61-ab72bc8783c4 tempest-VolumeQuotasAdminTestJSON-162463294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-943ee3b4-7dd7-4034-ae9c-ec1f20b57d39" returned: 0 in 0.887s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2cd49327-f1b1-485c-be61-ab72bc8783c4 tempest-VolumeQuotasAdminTestJSON-162463294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-943ee3b4-7dd7-4034-ae9c-ec1f20b57d39 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:48 devstack sudo[97688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-943ee3b4-7dd7-4034-ae9c-ec1f20b57d39 Jul 03 01:12:48 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:48 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5dbe3082-d9b3-4ec8-8c3d-028773efc631 tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546" returned: 0 in 0.885s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:48 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-5dbe3082-d9b3-4ec8-8c3d-028773efc631 tempest-VolumesSnapshotListTestJSON-959609686 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546 is being set with open permissions: ugo+rw Jul 03 01:12:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5dbe3082-d9b3-4ec8-8c3d-028773efc631 tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:48 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546 Jul 03 01:12:48 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:48 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2cd49327-f1b1-485c-be61-ab72bc8783c4 tempest-VolumeQuotasAdminTestJSON-162463294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-943ee3b4-7dd7-4034-ae9c-ec1f20b57d39" returned: 0 in 0.828s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2cd49327-f1b1-485c-be61-ab72bc8783c4 tempest-VolumeQuotasAdminTestJSON-162463294 None] Lock "cinder-quobyte-943ee3b4-7dd7-4034-ae9c-ec1f20b57d39" released by "delete_volume" :: held 1.778s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-2cd49327-f1b1-485c-be61-ab72bc8783c4 tempest-VolumeQuotasAdminTestJSON-162463294 None] Created reservations ['6d5a2642-cd7b-4acc-bb11-6906e4e0104b', '53eed85f-4343-455c-9fb8-99864b1915ac', 'e6711a19-93d3-4973-8369-6d342071f2f1', '45952b88-844a-4c22-8c2c-06ae470ce047'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2cd49327-f1b1-485c-be61-ab72bc8783c4 tempest-VolumeQuotasAdminTestJSON-162463294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2cd49327-f1b1-485c-be61-ab72bc8783c4 tempest-VolumeQuotasAdminTestJSON-162463294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2cd49327-f1b1-485c-be61-ab72bc8783c4 tempest-VolumeQuotasAdminTestJSON-162463294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2cd49327-f1b1-485c-be61-ab72bc8783c4 tempest-VolumeQuotasAdminTestJSON-162463294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2cd49327-f1b1-485c-be61-ab72bc8783c4 tempest-VolumeQuotasAdminTestJSON-162463294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2cd49327-f1b1-485c-be61-ab72bc8783c4 tempest-VolumeQuotasAdminTestJSON-162463294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:49 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:49 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:12:49 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_c7w2h916devstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae" returned: 0 in 2.356s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_c7w2h916devstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:12:49 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Converted 112.00 MB image at 47.51 MB/s Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:49 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae 1G Jul 03 01:12:49 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:49 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5dbe3082-d9b3-4ec8-8c3d-028773efc631 tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546" returned: 0 in 0.855s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5dbe3082-d9b3-4ec8-8c3d-028773efc631 tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.822s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:49 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5dbe3082-d9b3-4ec8-8c3d-028773efc631 tempest-VolumesSnapshotListTestJSON-959609686 None] Create snapshot completed successfully Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Flow 'volume_create_manager' (7b12b5a0-b11d-465a-bd3c-1916daf26274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41eb354-6cce-4d1f-a605-30d01ea62383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41eb354-6cce-4d1f-a605-30d01ea62383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1604414969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80cdc71d-2758-42b0-87ed-d03484706ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3bb599f6564371a46a41f86fce86d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:50Z,use_quota=True,user_id='9ee6c32b4a4a41c2aa131192716b8ebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed3c957b-5ba8-4f5e-8413-e950c6235df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed3c957b-5ba8-4f5e-8413-e950c6235df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeed859b-15cb-4a6f-b45e-3a4bad699957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeed859b-15cb-4a6f-b45e-3a4bad699957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80cdc71d-2758-42b0-87ed-d03484706ac6', 'volume_name': 'volume-80cdc71d-2758-42b0-87ed-d03484706ac6', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:49 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14117331-03e4-4e78-adef-4e895a32ab8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14117331-03e4-4e78-adef-4e895a32ab8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d302ee-30b6-4393-a416-6a92f8e9be37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:49 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Volume 80cdc71d-2758-42b0-87ed-d03484706ac6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80cdc71d-2758-42b0-87ed-d03484706ac6', 'volume_size': 1} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1604414969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80cdc71d-2758-42b0-87ed-d03484706ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3bb599f6564371a46a41f86fce86d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:50Z,use_quota=True,user_id='9ee6c32b4a4a41c2aa131192716b8ebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Creating volume 80cdc71d-2758-42b0-87ed-d03484706ac6 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:12:49 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:12:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-80cdc71d-2758-42b0-87ed-d03484706ac6 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2cd49327-f1b1-485c-be61-ab72bc8783c4 tempest-VolumeQuotasAdminTestJSON-162463294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.879s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:50 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-2cd49327-f1b1-485c-be61-ab72bc8783c4 tempest-VolumeQuotasAdminTestJSON-162463294 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:12:50 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-80cdc71d-2758-42b0-87ed-d03484706ac6 1073741824 Jul 03 01:12:50 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-2cd49327-f1b1-485c-be61-ab72bc8783c4 tempest-VolumeQuotasAdminTestJSON-162463294 None] Deleted volume successfully. Jul 03 01:12:50 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2cd49327-f1b1-485c-be61-ab72bc8783c4 tempest-VolumeQuotasAdminTestJSON-162463294 None] Lock "cinder-943ee3b4-7dd7-4034-ae9c-ec1f20b57d39-delete_volume" released by "delete_volume" :: held 2.982s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:50 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae 1G" returned: 0 in 0.923s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:50 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc88643-9c71-4999-8614-6637889c91be]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:50 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae Jul 03 01:12:50 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d3a713b4-3dbc-436f-93de-9f0bd6d3e8e1 tempest-VolumesSnapshotListTestJSON-959609686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:50 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-80cdc71d-2758-42b0-87ed-d03484706ac6 1073741824" returned: 0 in 1.000s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-80cdc71d-2758-42b0-87ed-d03484706ac6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:51 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae" returned: 0 in 0.928s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:51 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-80cdc71d-2758-42b0-87ed-d03484706ac6 Jul 03 01:12:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:51 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:51 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae Jul 03 01:12:51 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:51 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-80cdc71d-2758-42b0-87ed-d03484706ac6" returned: 0 in 0.734s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:51 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:12:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d3a713b4-3dbc-436f-93de-9f0bd6d3e8e1 tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.404s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d302ee-30b6-4393-a416-6a92f8e9be37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80cdc71d-2758-42b0-87ed-d03484706ac6', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82166efd-3a74-4447-ad51-8ca6e3188eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:51 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-d3a713b4-3dbc-436f-93de-9f0bd6d3e8e1 tempest-VolumesSnapshotListTestJSON-959609686 None] Creating offline snapshot c6309cc3-5537-40d1-b316-c7690061b5a8 of volume 3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:12:51 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Volume volume-80cdc71d-2758-42b0-87ed-d03484706ac6 (80cdc71d-2758-42b0-87ed-d03484706ac6): created successfully Jul 03 01:12:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82166efd-3a74-4447-ad51-8ca6e3188eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Flow 'volume_create_manager' (7b12b5a0-b11d-465a-bd3c-1916daf26274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:51 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[88aefaec-3c7a-4012-829f-447e6c9d5bd0]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d3a713b4-3dbc-436f-93de-9f0bd6d3e8e1 tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:51 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5d3778bf-1f46-4a2f-9ce1-5fc8db37fbd7 tempest-VolumeQuotasAdminTestJSON-162463294 None] Created volume successfully. Jul 03 01:12:51 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae" returned: 1 in 0.907s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:12:51 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Downloaded image 3d536ca8-2cba-4b44-93ed-ed247e842444 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d536ca8-2cba-4b44-93ed-ed247e842444', 'metadata': {}}])) to volume 44128ad7-6fe9-4f97-a044-891e111be6ae successfully. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 01:12:51 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Temporary image 3d536ca8-2cba-4b44-93ed-ed247e842444 for user fef647283c8f44fe9bd38698c904df52 is deleted. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 01:12:51 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Marking volume 44128ad7-6fe9-4f97-a044-891e111be6ae as bootable. {{(pid=86772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 01:12:52 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Copying metadata from image 3d536ca8-2cba-4b44-93ed-ed247e842444 to 44128ad7-6fe9-4f97-a044-891e111be6ae. {{(pid=86772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 01:12:52 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Creating volume glance metadata for volume 44128ad7-6fe9-4f97-a044-891e111be6ae backed by image 3d536ca8-2cba-4b44-93ed-ed247e842444 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 01:12:52 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546 Jul 03 01:12:52 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63656cb-2786-44b0-ac80-0fba22111978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44128ad7-6fe9-4f97-a044-891e111be6ae', 'volume_size': 1, 'image_id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d536ca8-2cba-4b44-93ed-ed247e842444', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b88b4a33269476b9f6e11e7fe82fb87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'created_at': datetime.datetime(2026, 7, 2, 22, 56, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 56, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d536ca8-2cba-4b44-93ed-ed247e842444/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f52a508e-577e-4d79-a9ee-27f5bc879446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:52 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Volume volume-44128ad7-6fe9-4f97-a044-891e111be6ae (44128ad7-6fe9-4f97-a044-891e111be6ae): created successfully Jul 03 01:12:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f52a508e-577e-4d79-a9ee-27f5bc879446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Flow 'volume_create_manager' (696abaf1-5b25-4373-82ae-91df2a2be167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:52 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1d1ea60b-940f-47f1-a3a1-c8fb24d7b59b tempest-VolumesGetTest-1433751156 None] Created volume successfully. Jul 03 01:12:52 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d3a713b4-3dbc-436f-93de-9f0bd6d3e8e1 tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546" returned: 0 in 0.915s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-d3a713b4-3dbc-436f-93de-9f0bd6d3e8e1 tempest-VolumesSnapshotListTestJSON-959609686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:12:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d3a713b4-3dbc-436f-93de-9f0bd6d3e8e1 tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.c6309cc3-5537-40d1-b316-c7690061b5a8 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:52 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.c6309cc3-5537-40d1-b316-c7690061b5a8 1G Jul 03 01:12:52 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:53 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:12:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Flow 'volume_create_manager' (add27e13-30ad-4323-baed-a765255f76bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a980f1-e750-4493-80cd-679a1c0a7dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a980f1-e750-4493-80cd-679a1c0a7dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-208313290',display_name='tempest-VolumesGetTest-Volume-241719589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3a1b75-4f50-4230-b6cb-c2942c502904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6354242950304d4ea09e1cd99a0a4c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:53Z,use_quota=True,user_id='fef647283c8f44fe9bd38698c904df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16182962-5ef2-4ca8-b5da-b067c1d523cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16182962-5ef2-4ca8-b5da-b067c1d523cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328987df-9ad6-4538-90d7-72ef6b975121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328987df-9ad6-4538-90d7-72ef6b975121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a3a1b75-4f50-4230-b6cb-c2942c502904', 'volume_name': 'volume-8a3a1b75-4f50-4230-b6cb-c2942c502904', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b36aaac1-6d12-4dc8-8048-649d8f4ffa34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b36aaac1-6d12-4dc8-8048-649d8f4ffa34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea686725-6384-4c42-bf13-9fd05156baa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:53 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Volume 8a3a1b75-4f50-4230-b6cb-c2942c502904: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a3a1b75-4f50-4230-b6cb-c2942c502904', 'volume_size': 1} Jul 03 01:12:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:53 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b2f7e7aa-1540-48ac-9c7d-23ae1a661ca7 tempest-VolumeQuotasAdminTestJSON-1065994469 None] Transfer volume completed successfully. Jul 03 01:12:53 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d3a713b4-3dbc-436f-93de-9f0bd6d3e8e1 tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.c6309cc3-5537-40d1-b316-c7690061b5a8 1G" returned: 0 in 1.176s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d3a713b4-3dbc-436f-93de-9f0bd6d3e8e1 tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.c6309cc3-5537-40d1-b316-c7690061b5a8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:54 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.c6309cc3-5537-40d1-b316-c7690061b5a8 Jul 03 01:12:54 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:54 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d3a713b4-3dbc-436f-93de-9f0bd6d3e8e1 tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.c6309cc3-5537-40d1-b316-c7690061b5a8" returned: 0 in 0.788s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:54 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-d3a713b4-3dbc-436f-93de-9f0bd6d3e8e1 tempest-VolumesSnapshotListTestJSON-959609686 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.c6309cc3-5537-40d1-b316-c7690061b5a8 is being set with open permissions: ugo+rw Jul 03 01:12:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d3a713b4-3dbc-436f-93de-9f0bd6d3e8e1 tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.c6309cc3-5537-40d1-b316-c7690061b5a8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:54 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.c6309cc3-5537-40d1-b316-c7690061b5a8 Jul 03 01:12:54 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2d337030-a080-4b81-a118-517d499dd2a4 tempest-VolumeQuotasAdminTestJSON-916119940 None] Acquiring lock "cinder-80cdc71d-2758-42b0-87ed-d03484706ac6-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2d337030-a080-4b81-a118-517d499dd2a4 tempest-VolumeQuotasAdminTestJSON-916119940 None] Lock "cinder-80cdc71d-2758-42b0-87ed-d03484706ac6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2d337030-a080-4b81-a118-517d499dd2a4 tempest-VolumeQuotasAdminTestJSON-916119940 None] Acquiring lock "cinder-quobyte-80cdc71d-2758-42b0-87ed-d03484706ac6" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2d337030-a080-4b81-a118-517d499dd2a4 tempest-VolumeQuotasAdminTestJSON-916119940 None] Lock "cinder-quobyte-80cdc71d-2758-42b0-87ed-d03484706ac6" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:55 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e150c28-86af-4f05-9a7a-536b08b14a72]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2d337030-a080-4b81-a118-517d499dd2a4 tempest-VolumeQuotasAdminTestJSON-916119940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-80cdc71d-2758-42b0-87ed-d03484706ac6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:55 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-80cdc71d-2758-42b0-87ed-d03484706ac6 Jul 03 01:12:55 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:55 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d3a713b4-3dbc-436f-93de-9f0bd6d3e8e1 tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.c6309cc3-5537-40d1-b316-c7690061b5a8" returned: 0 in 0.699s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d3a713b4-3dbc-436f-93de-9f0bd6d3e8e1 tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.764s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.899s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:12:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-208313290',display_name='tempest-VolumesGetTest-Volume-241719589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3a1b75-4f50-4230-b6cb-c2942c502904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6354242950304d4ea09e1cd99a0a4c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:12:53Z,use_quota=True,user_id='fef647283c8f44fe9bd38698c904df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:12:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Creating volume 8a3a1b75-4f50-4230-b6cb-c2942c502904 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:12:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:12:55 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:12:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8a3a1b75-4f50-4230-b6cb-c2942c502904 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:55 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8a3a1b75-4f50-4230-b6cb-c2942c502904 1073741824 Jul 03 01:12:55 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:55 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d3a713b4-3dbc-436f-93de-9f0bd6d3e8e1 tempest-VolumesSnapshotListTestJSON-959609686 None] Create snapshot completed successfully Jul 03 01:12:55 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2d337030-a080-4b81-a118-517d499dd2a4 tempest-VolumeQuotasAdminTestJSON-916119940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-80cdc71d-2758-42b0-87ed-d03484706ac6" returned: 0 in 0.830s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2d337030-a080-4b81-a118-517d499dd2a4 tempest-VolumeQuotasAdminTestJSON-916119940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-80cdc71d-2758-42b0-87ed-d03484706ac6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:55 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-80cdc71d-2758-42b0-87ed-d03484706ac6 Jul 03 01:12:55 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:56 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8a3a1b75-4f50-4230-b6cb-c2942c502904 1073741824" returned: 0 in 0.878s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8a3a1b75-4f50-4230-b6cb-c2942c502904 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:56 devstack sudo[97763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8a3a1b75-4f50-4230-b6cb-c2942c502904 Jul 03 01:12:56 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:56 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2d337030-a080-4b81-a118-517d499dd2a4 tempest-VolumeQuotasAdminTestJSON-916119940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-80cdc71d-2758-42b0-87ed-d03484706ac6" returned: 0 in 0.743s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2d337030-a080-4b81-a118-517d499dd2a4 tempest-VolumeQuotasAdminTestJSON-916119940 None] Lock "cinder-quobyte-80cdc71d-2758-42b0-87ed-d03484706ac6" released by "delete_volume" :: held 1.625s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:56 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-2d337030-a080-4b81-a118-517d499dd2a4 tempest-VolumeQuotasAdminTestJSON-916119940 None] Created reservations ['47ca821b-ce0b-4ae1-bde4-b769a2e27114', 'd86e73ef-8da3-44a1-ae51-385da2d94020', 'cc01e418-b691-4e90-a8b5-c7d1934a1c9f', '1112cb06-6f36-477d-ac0f-9c2c02d8ba5f'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:12:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2d337030-a080-4b81-a118-517d499dd2a4 tempest-VolumeQuotasAdminTestJSON-916119940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:12:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2d337030-a080-4b81-a118-517d499dd2a4 tempest-VolumeQuotasAdminTestJSON-916119940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:12:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2d337030-a080-4b81-a118-517d499dd2a4 tempest-VolumeQuotasAdminTestJSON-916119940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:12:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2d337030-a080-4b81-a118-517d499dd2a4 tempest-VolumeQuotasAdminTestJSON-916119940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:12:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2d337030-a080-4b81-a118-517d499dd2a4 tempest-VolumeQuotasAdminTestJSON-916119940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2d337030-a080-4b81-a118-517d499dd2a4 tempest-VolumeQuotasAdminTestJSON-916119940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:56 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:12:56 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:57 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8a3a1b75-4f50-4230-b6cb-c2942c502904" returned: 0 in 0.921s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:12:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:12:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea686725-6384-4c42-bf13-9fd05156baa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a3a1b75-4f50-4230-b6cb-c2942c502904', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add0f890-2ccc-47cc-98df-0059dae87fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:12:57 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Volume volume-8a3a1b75-4f50-4230-b6cb-c2942c502904 (8a3a1b75-4f50-4230-b6cb-c2942c502904): created successfully Jul 03 01:12:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add0f890-2ccc-47cc-98df-0059dae87fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:12:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Flow 'volume_create_manager' (add27e13-30ad-4323-baed-a765255f76bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:12:57 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-da22d301-e4d8-4c90-8757-23c658a3c0fd tempest-VolumesGetTest-1433751156 None] Created volume successfully. Jul 03 01:12:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e4873025-21c1-465b-83b2-08cd3b4bca28 tempest-VolumesSnapshotListTestJSON-959609686 None] Acquiring lock "cinder-c6309cc3-5537-40d1-b316-c7690061b5a8-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e4873025-21c1-465b-83b2-08cd3b4bca28 tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "cinder-c6309cc3-5537-40d1-b316-c7690061b5a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e4873025-21c1-465b-83b2-08cd3b4bca28 tempest-VolumesSnapshotListTestJSON-959609686 None] Acquiring lock "cinder-quobyte-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e4873025-21c1-465b-83b2-08cd3b4bca28 tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "cinder-quobyte-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e4873025-21c1-465b-83b2-08cd3b4bca28 tempest-VolumesSnapshotListTestJSON-959609686 None] Acquiring lock "cinder-quobyte-c6309cc3-5537-40d1-b316-c7690061b5a8" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e4873025-21c1-465b-83b2-08cd3b4bca28 tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "cinder-quobyte-c6309cc3-5537-40d1-b316-c7690061b5a8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e4873025-21c1-465b-83b2-08cd3b4bca28 tempest-VolumesSnapshotListTestJSON-959609686 None] Deleting offline snapshot c6309cc3-5537-40d1-b316-c7690061b5a8 of volume 3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:12:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e4873025-21c1-465b-83b2-08cd3b4bca28 tempest-VolumesSnapshotListTestJSON-959609686 None] snapshot_file for this snap is: volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.c6309cc3-5537-40d1-b316-c7690061b5a8 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:12:57 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2afb4a5-46be-42c2-858e-53a5b024699f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e4873025-21c1-465b-83b2-08cd3b4bca28 tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.c6309cc3-5537-40d1-b316-c7690061b5a8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:57 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2d337030-a080-4b81-a118-517d499dd2a4 tempest-VolumeQuotasAdminTestJSON-916119940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.033s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:57 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-2d337030-a080-4b81-a118-517d499dd2a4 tempest-VolumeQuotasAdminTestJSON-916119940 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:12:57 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-2d337030-a080-4b81-a118-517d499dd2a4 tempest-VolumeQuotasAdminTestJSON-916119940 None] Deleted volume successfully. Jul 03 01:12:57 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.c6309cc3-5537-40d1-b316-c7690061b5a8 Jul 03 01:12:57 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2d337030-a080-4b81-a118-517d499dd2a4 tempest-VolumeQuotasAdminTestJSON-916119940 None] Lock "cinder-80cdc71d-2758-42b0-87ed-d03484706ac6-delete_volume" released by "delete_volume" :: held 2.926s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:12:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d8a7140e-5b40-4720-971a-cf831f94dc8a tempest-VolumesGetTest-1433751156 None] Acquiring lock "cinder-8a3a1b75-4f50-4230-b6cb-c2942c502904-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d8a7140e-5b40-4720-971a-cf831f94dc8a tempest-VolumesGetTest-1433751156 None] Lock "cinder-8a3a1b75-4f50-4230-b6cb-c2942c502904-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d8a7140e-5b40-4720-971a-cf831f94dc8a tempest-VolumesGetTest-1433751156 None] Acquiring lock "cinder-quobyte-8a3a1b75-4f50-4230-b6cb-c2942c502904" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:12:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d8a7140e-5b40-4720-971a-cf831f94dc8a tempest-VolumesGetTest-1433751156 None] Lock "cinder-quobyte-8a3a1b75-4f50-4230-b6cb-c2942c502904" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:12:58 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9793627-df6f-414d-ab28-e4fd899afef5]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d8a7140e-5b40-4720-971a-cf831f94dc8a tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8a3a1b75-4f50-4230-b6cb-c2942c502904 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:58 devstack sudo[97772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8a3a1b75-4f50-4230-b6cb-c2942c502904 Jul 03 01:12:58 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:58 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e4873025-21c1-465b-83b2-08cd3b4bca28 tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.c6309cc3-5537-40d1-b316-c7690061b5a8" returned: 0 in 1.004s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:58 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e4873025-21c1-465b-83b2-08cd3b4bca28 tempest-VolumesSnapshotListTestJSON-959609686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:12:58 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e563708b-8570-4f2b-99f6-4c0343ec9cd4]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:12:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e4873025-21c1-465b-83b2-08cd3b4bca28 tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:58 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546 Jul 03 01:12:58 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:59 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d8a7140e-5b40-4720-971a-cf831f94dc8a tempest-VolumesGetTest-1433751156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8a3a1b75-4f50-4230-b6cb-c2942c502904" returned: 0 in 1.010s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d8a7140e-5b40-4720-971a-cf831f94dc8a tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8a3a1b75-4f50-4230-b6cb-c2942c502904 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:59 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8a3a1b75-4f50-4230-b6cb-c2942c502904 Jul 03 01:12:59 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:59 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e4873025-21c1-465b-83b2-08cd3b4bca28 tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546" returned: 0 in 0.957s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e4873025-21c1-465b-83b2-08cd3b4bca28 tempest-VolumesSnapshotListTestJSON-959609686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:12:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e4873025-21c1-465b-83b2-08cd3b4bca28 tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.c6309cc3-5537-40d1-b316-c7690061b5a8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:12:59 devstack sudo[97790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.c6309cc3-5537-40d1-b316-c7690061b5a8 Jul 03 01:12:59 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:12:59 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Jul 03 01:12:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d8a7140e-5b40-4720-971a-cf831f94dc8a tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8a3a1b75-4f50-4230-b6cb-c2942c502904" returned: 0 in 0.853s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:12:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d8a7140e-5b40-4720-971a-cf831f94dc8a tempest-VolumesGetTest-1433751156 None] Lock "cinder-quobyte-8a3a1b75-4f50-4230-b6cb-c2942c502904" released by "delete_volume" :: held 1.923s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:00 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-d8a7140e-5b40-4720-971a-cf831f94dc8a tempest-VolumesGetTest-1433751156 None] Created reservations ['86693bc3-c475-4d9b-bcf0-b3cbae48da96', '7b220661-f55f-4be7-93f6-b6e454e0d31f', '1bfd9047-77d2-42a0-9c70-53a41483c9e5', 'f09afaf2-952f-4799-8645-7ad2b1b89de8'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:13:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d8a7140e-5b40-4720-971a-cf831f94dc8a tempest-VolumesGetTest-1433751156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d8a7140e-5b40-4720-971a-cf831f94dc8a tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d8a7140e-5b40-4720-971a-cf831f94dc8a tempest-VolumesGetTest-1433751156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d8a7140e-5b40-4720-971a-cf831f94dc8a tempest-VolumesGetTest-1433751156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d8a7140e-5b40-4720-971a-cf831f94dc8a tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d8a7140e-5b40-4720-971a-cf831f94dc8a tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:00 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:13:00 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-63b1cc16-b3a9-40ca-933d-076e48d5efb3 tempest-VolumesGetTest-1433751156 None] Acquiring lock "cinder-44128ad7-6fe9-4f97-a044-891e111be6ae-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-63b1cc16-b3a9-40ca-933d-076e48d5efb3 tempest-VolumesGetTest-1433751156 None] Lock "cinder-44128ad7-6fe9-4f97-a044-891e111be6ae-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-63b1cc16-b3a9-40ca-933d-076e48d5efb3 tempest-VolumesGetTest-1433751156 None] Acquiring lock "cinder-quobyte-44128ad7-6fe9-4f97-a044-891e111be6ae" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-63b1cc16-b3a9-40ca-933d-076e48d5efb3 tempest-VolumesGetTest-1433751156 None] Lock "cinder-quobyte-44128ad7-6fe9-4f97-a044-891e111be6ae" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:00 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[633ff43f-0d47-440b-acf2-16daa085fb18]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-63b1cc16-b3a9-40ca-933d-076e48d5efb3 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:00 devstack sudo[97798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae Jul 03 01:13:00 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:01 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e4873025-21c1-465b-83b2-08cd3b4bca28 tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.c6309cc3-5537-40d1-b316-c7690061b5a8" returned: 0 in 1.382s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e4873025-21c1-465b-83b2-08cd3b4bca28 tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.c6309cc3-5537-40d1-b316-c7690061b5a8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:01 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.c6309cc3-5537-40d1-b316-c7690061b5a8 Jul 03 01:13:01 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:01 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d8a7140e-5b40-4720-971a-cf831f94dc8a tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.142s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:01 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-d8a7140e-5b40-4720-971a-cf831f94dc8a tempest-VolumesGetTest-1433751156 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:13:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d8a7140e-5b40-4720-971a-cf831f94dc8a tempest-VolumesGetTest-1433751156 None] Deleted volume successfully. Jul 03 01:13:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d8a7140e-5b40-4720-971a-cf831f94dc8a tempest-VolumesGetTest-1433751156 None] Lock "cinder-8a3a1b75-4f50-4230-b6cb-c2942c502904-delete_volume" released by "delete_volume" :: held 3.427s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:01 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-63b1cc16-b3a9-40ca-933d-076e48d5efb3 tempest-VolumesGetTest-1433751156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae" returned: 0 in 1.245s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-63b1cc16-b3a9-40ca-933d-076e48d5efb3 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:02 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae Jul 03 01:13:02 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:02 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e4873025-21c1-465b-83b2-08cd3b4bca28 tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.c6309cc3-5537-40d1-b316-c7690061b5a8" returned: 0 in 1.134s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e4873025-21c1-465b-83b2-08cd3b4bca28 tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "cinder-quobyte-c6309cc3-5537-40d1-b316-c7690061b5a8" released by "_delete_snapshot" :: held 4.641s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e4873025-21c1-465b-83b2-08cd3b4bca28 tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "cinder-quobyte-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92" released by "delete_snapshot" :: held 4.674s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:02 devstack cinder-volume[86772]: WARNING cinder.quota [None req-e4873025-21c1-465b-83b2-08cd3b4bca28 tempest-VolumesSnapshotListTestJSON-959609686 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:13:02 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e4873025-21c1-465b-83b2-08cd3b4bca28 tempest-VolumesSnapshotListTestJSON-959609686 None] Created reservations ['16d79e79-3646-4fdb-a156-ac05623a9cff', '08fec937-14d0-4b54-af24-3b8e4cae04fb', '3c6e4ac9-65e3-453a-9ba1-daff5050a3b5', 'd4d3a2de-1390-4a9d-9b74-88ae570a4637'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:13:02 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e4873025-21c1-465b-83b2-08cd3b4bca28 tempest-VolumesSnapshotListTestJSON-959609686 None] Delete snapshot completed successfully. Jul 03 01:13:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e4873025-21c1-465b-83b2-08cd3b4bca28 tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "cinder-c6309cc3-5537-40d1-b316-c7690061b5a8-delete_snapshot" released by "delete_snapshot" :: held 4.904s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a3dac048-738b-4e25-b16b-30578cccb22a tempest-VolumesSnapshotListTestJSON-959609686 None] Acquiring lock "cinder-6aaff32b-f41f-41bf-969a-593c8bfcd546-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a3dac048-738b-4e25-b16b-30578cccb22a tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "cinder-6aaff32b-f41f-41bf-969a-593c8bfcd546-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a3dac048-738b-4e25-b16b-30578cccb22a tempest-VolumesSnapshotListTestJSON-959609686 None] Acquiring lock "cinder-quobyte-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a3dac048-738b-4e25-b16b-30578cccb22a tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "cinder-quobyte-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a3dac048-738b-4e25-b16b-30578cccb22a tempest-VolumesSnapshotListTestJSON-959609686 None] Acquiring lock "cinder-quobyte-6aaff32b-f41f-41bf-969a-593c8bfcd546" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a3dac048-738b-4e25-b16b-30578cccb22a tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "cinder-quobyte-6aaff32b-f41f-41bf-969a-593c8bfcd546" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a3dac048-738b-4e25-b16b-30578cccb22a tempest-VolumesSnapshotListTestJSON-959609686 None] Deleting offline snapshot 6aaff32b-f41f-41bf-969a-593c8bfcd546 of volume 3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:13:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a3dac048-738b-4e25-b16b-30578cccb22a tempest-VolumesSnapshotListTestJSON-959609686 None] snapshot_file for this snap is: volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:13:03 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fac367b-3dff-4e0e-afd5-5507aa1ef8fa]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a3dac048-738b-4e25-b16b-30578cccb22a tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:03 devstack sudo[97829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546 Jul 03 01:13:03 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:03 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-63b1cc16-b3a9-40ca-933d-076e48d5efb3 tempest-VolumesGetTest-1433751156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae" returned: 1 in 1.418s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-63b1cc16-b3a9-40ca-933d-076e48d5efb3 tempest-VolumesGetTest-1433751156 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:13:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-63b1cc16-b3a9-40ca-933d-076e48d5efb3 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:03 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae Jul 03 01:13:03 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:04 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-63b1cc16-b3a9-40ca-933d-076e48d5efb3 tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44128ad7-6fe9-4f97-a044-891e111be6ae" returned: 0 in 0.841s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-63b1cc16-b3a9-40ca-933d-076e48d5efb3 tempest-VolumesGetTest-1433751156 None] Lock "cinder-quobyte-44128ad7-6fe9-4f97-a044-891e111be6ae" released by "delete_volume" :: held 3.658s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:04 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a3dac048-738b-4e25-b16b-30578cccb22a tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546" returned: 0 in 1.160s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a3dac048-738b-4e25-b16b-30578cccb22a tempest-VolumesSnapshotListTestJSON-959609686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:13:04 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb28f2e0-65c5-4fce-8732-e04ed4afddc3]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a3dac048-738b-4e25-b16b-30578cccb22a tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:04 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-63b1cc16-b3a9-40ca-933d-076e48d5efb3 tempest-VolumesGetTest-1433751156 None] Created reservations ['8fe39f15-e1df-444c-a236-7dd42c1cfae8', 'c9499226-4c81-40b4-ae80-b10006984766', '19dbb047-72de-4866-ac67-7994eb821865', 'bd57bdbb-87b3-4a79-b035-194c4f5b3526'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:13:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-63b1cc16-b3a9-40ca-933d-076e48d5efb3 tempest-VolumesGetTest-1433751156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-63b1cc16-b3a9-40ca-933d-076e48d5efb3 tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-63b1cc16-b3a9-40ca-933d-076e48d5efb3 tempest-VolumesGetTest-1433751156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-63b1cc16-b3a9-40ca-933d-076e48d5efb3 tempest-VolumesGetTest-1433751156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-63b1cc16-b3a9-40ca-933d-076e48d5efb3 tempest-VolumesGetTest-1433751156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-63b1cc16-b3a9-40ca-933d-076e48d5efb3 tempest-VolumesGetTest-1433751156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:04 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a Jul 03 01:13:04 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:04 devstack sudo[97840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:13:04 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:05 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-63b1cc16-b3a9-40ca-933d-076e48d5efb3 tempest-VolumesGetTest-1433751156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.883s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:05 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-63b1cc16-b3a9-40ca-933d-076e48d5efb3 tempest-VolumesGetTest-1433751156 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:13:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-63b1cc16-b3a9-40ca-933d-076e48d5efb3 tempest-VolumesGetTest-1433751156 None] Deleted volume successfully. Jul 03 01:13:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-63b1cc16-b3a9-40ca-933d-076e48d5efb3 tempest-VolumesGetTest-1433751156 None] Lock "cinder-44128ad7-6fe9-4f97-a044-891e111be6ae-delete_volume" released by "delete_volume" :: held 4.925s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:05 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a3dac048-738b-4e25-b16b-30578cccb22a tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a" returned: 0 in 1.126s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a3dac048-738b-4e25-b16b-30578cccb22a tempest-VolumesSnapshotListTestJSON-959609686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:13:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a3dac048-738b-4e25-b16b-30578cccb22a tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:05 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546 Jul 03 01:13:05 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:06 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a3dac048-738b-4e25-b16b-30578cccb22a tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546" returned: 0 in 0.966s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a3dac048-738b-4e25-b16b-30578cccb22a tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:06 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546 Jul 03 01:13:06 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:07 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a3dac048-738b-4e25-b16b-30578cccb22a tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.6aaff32b-f41f-41bf-969a-593c8bfcd546" returned: 0 in 0.968s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a3dac048-738b-4e25-b16b-30578cccb22a tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "cinder-quobyte-6aaff32b-f41f-41bf-969a-593c8bfcd546" released by "_delete_snapshot" :: held 4.346s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a3dac048-738b-4e25-b16b-30578cccb22a tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "cinder-quobyte-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92" released by "delete_snapshot" :: held 4.381s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-a3dac048-738b-4e25-b16b-30578cccb22a tempest-VolumesSnapshotListTestJSON-959609686 None] Created reservations ['7249c5b1-3e5b-4c74-aa76-ffca1e125148', 'dcd80ace-a94f-406f-8267-70417c0102ee', '7e4b2a3c-589a-4138-b23b-968fef797ad6', 'e77810b6-f1f4-42de-80fe-8a2ce99ff498'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:13:07 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a3dac048-738b-4e25-b16b-30578cccb22a tempest-VolumesSnapshotListTestJSON-959609686 None] Delete snapshot completed successfully. Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a3dac048-738b-4e25-b16b-30578cccb22a tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "cinder-6aaff32b-f41f-41bf-969a-593c8bfcd546-delete_snapshot" released by "delete_snapshot" :: held 4.577s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Flow 'volume_create_manager' (1cf98db8-bead-46bd-b9ae-fd056dcc179c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df261d1-8efc-4f80-af0d-cc5c92a3ceb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df261d1-8efc-4f80-af0d-cc5c92a3ceb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2082908074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9019682d-a661-47ec-bd54-fdbb5cb917eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d1edff5bcc4382adabee36e484112f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:08Z,use_quota=True,user_id='384fcf12dcb04bb1a07d1630c060dc85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de839a35-1599-4849-8354-2f20a3e60bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de839a35-1599-4849-8354-2f20a3e60bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c9e2aba-0048-4ece-bc02-61aab84b6b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c9e2aba-0048-4ece-bc02-61aab84b6b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9019682d-a661-47ec-bd54-fdbb5cb917eb', 'volume_name': 'volume-9019682d-a661-47ec-bd54-fdbb5cb917eb', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (578f1191-691c-45e7-a1f0-d537eb2c2c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (578f1191-691c-45e7-a1f0-d537eb2c2c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a71390-4d29-4bab-80ce-85e6baeee472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:07 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Volume 9019682d-a661-47ec-bd54-fdbb5cb917eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9019682d-a661-47ec-bd54-fdbb5cb917eb', 'volume_size': 1} Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2082908074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9019682d-a661-47ec-bd54-fdbb5cb917eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7d1edff5bcc4382adabee36e484112f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:08Z,use_quota=True,user_id='384fcf12dcb04bb1a07d1630c060dc85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Creating volume 9019682d-a661-47ec-bd54-fdbb5cb917eb {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:13:07 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:13:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9019682d-a661-47ec-bd54-fdbb5cb917eb 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:07 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9019682d-a661-47ec-bd54-fdbb5cb917eb 1073741824 Jul 03 01:13:07 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-da335c7e-3920-4cea-9d86-e8f2e8c53a6c tempest-VolumesSnapshotListTestJSON-959609686 None] Acquiring lock "cinder-ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-da335c7e-3920-4cea-9d86-e8f2e8c53a6c tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "cinder-ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-da335c7e-3920-4cea-9d86-e8f2e8c53a6c tempest-VolumesSnapshotListTestJSON-959609686 None] Acquiring lock "cinder-quobyte-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-da335c7e-3920-4cea-9d86-e8f2e8c53a6c tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "cinder-quobyte-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-da335c7e-3920-4cea-9d86-e8f2e8c53a6c tempest-VolumesSnapshotListTestJSON-959609686 None] Acquiring lock "cinder-quobyte-ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-da335c7e-3920-4cea-9d86-e8f2e8c53a6c tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "cinder-quobyte-ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-da335c7e-3920-4cea-9d86-e8f2e8c53a6c tempest-VolumesSnapshotListTestJSON-959609686 None] Deleting offline snapshot ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a of volume 3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:13:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-da335c7e-3920-4cea-9d86-e8f2e8c53a6c tempest-VolumesSnapshotListTestJSON-959609686 None] snapshot_file for this snap is: volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:13:08 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3dc7ed-9cd8-40c4-8c27-651893e2fbbb]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-da335c7e-3920-4cea-9d86-e8f2e8c53a6c tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:08 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a Jul 03 01:13:08 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:08 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9019682d-a661-47ec-bd54-fdbb5cb917eb 1073741824" returned: 0 in 1.028s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9019682d-a661-47ec-bd54-fdbb5cb917eb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:08 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9019682d-a661-47ec-bd54-fdbb5cb917eb Jul 03 01:13:08 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:09 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-da335c7e-3920-4cea-9d86-e8f2e8c53a6c tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a" returned: 0 in 1.001s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-da335c7e-3920-4cea-9d86-e8f2e8c53a6c tempest-VolumesSnapshotListTestJSON-959609686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:13:09 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4702a50-6a3c-44e0-b773-d650ad11b976]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-da335c7e-3920-4cea-9d86-e8f2e8c53a6c tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:09 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9019682d-a661-47ec-bd54-fdbb5cb917eb" returned: 0 in 0.873s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:13:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:09 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92 Jul 03 01:13:09 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a71390-4d29-4bab-80ce-85e6baeee472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9019682d-a661-47ec-bd54-fdbb5cb917eb', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b045ebf7-9e46-4451-9e74-eaf918cad267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:09 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Volume volume-9019682d-a661-47ec-bd54-fdbb5cb917eb (9019682d-a661-47ec-bd54-fdbb5cb917eb): created successfully Jul 03 01:13:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b045ebf7-9e46-4451-9e74-eaf918cad267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Flow 'volume_create_manager' (1cf98db8-bead-46bd-b9ae-fd056dcc179c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:09 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8bf8394b-3d53-448e-b78f-6deed3c57779 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Created volume successfully. Jul 03 01:13:10 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-da335c7e-3920-4cea-9d86-e8f2e8c53a6c tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92" returned: 0 in 1.202s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-da335c7e-3920-4cea-9d86-e8f2e8c53a6c tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:10 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a Jul 03 01:13:10 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:12 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-da335c7e-3920-4cea-9d86-e8f2e8c53a6c tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a" returned: 0 in 1.490s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-da335c7e-3920-4cea-9d86-e8f2e8c53a6c tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:12 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a Jul 03 01:13:12 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:13:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:12 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:13:12 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dfb6665d-732b-4b86-a5b5-4f0151e81fa6 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Acquiring lock "cinder-9019682d-a661-47ec-bd54-fdbb5cb917eb-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dfb6665d-732b-4b86-a5b5-4f0151e81fa6 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Lock "cinder-9019682d-a661-47ec-bd54-fdbb5cb917eb-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:13 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=106,cinder:SELECT=93,cinder:INSERT=32,cinder:DELETE=9 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:13:13 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=111,cinder:SELECT=82,cinder:INSERT=31,cinder:DELETE=10 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:13:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dfb6665d-732b-4b86-a5b5-4f0151e81fa6 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Acquiring lock "cinder-quobyte-9019682d-a661-47ec-bd54-fdbb5cb917eb" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dfb6665d-732b-4b86-a5b5-4f0151e81fa6 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Lock "cinder-quobyte-9019682d-a661-47ec-bd54-fdbb5cb917eb" acquired by "delete_volume" :: waited 0.053s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:13 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b8a16a-00b9-488e-a37d-c787ddb6b9c8]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dfb6665d-732b-4b86-a5b5-4f0151e81fa6 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9019682d-a661-47ec-bd54-fdbb5cb917eb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:13 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9019682d-a661-47ec-bd54-fdbb5cb917eb Jul 03 01:13:13 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:13 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-da335c7e-3920-4cea-9d86-e8f2e8c53a6c tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92.ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a" returned: 0 in 1.556s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-da335c7e-3920-4cea-9d86-e8f2e8c53a6c tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "cinder-quobyte-ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a" released by "_delete_snapshot" :: held 5.492s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-da335c7e-3920-4cea-9d86-e8f2e8c53a6c tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "cinder-quobyte-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92" released by "delete_snapshot" :: held 5.536s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:14 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-da335c7e-3920-4cea-9d86-e8f2e8c53a6c tempest-VolumesSnapshotListTestJSON-959609686 None] Created reservations ['7da1a176-8b14-4f03-a13c-19c90fcb3de9', '1ab477bb-a427-4b76-8a96-3217c8e50d09', '018f4d7e-8a98-4cd5-b8e4-8cb864801ba3', '01944e85-a138-4e49-bc1d-892a2461716d'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:13:14 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-da335c7e-3920-4cea-9d86-e8f2e8c53a6c tempest-VolumesSnapshotListTestJSON-959609686 None] Delete snapshot completed successfully. Jul 03 01:13:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-da335c7e-3920-4cea-9d86-e8f2e8c53a6c tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "cinder-ec7ea2a7-af4e-4a2f-9a67-f9a7e7d4961a-delete_snapshot" released by "delete_snapshot" :: held 5.953s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:14 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.527s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:14 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:13:14 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:13:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:13:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:13:14 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dfb6665d-732b-4b86-a5b5-4f0151e81fa6 tempest-VolumeQuotasNegativeTestJSON-370299482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9019682d-a661-47ec-bd54-fdbb5cb917eb" returned: 0 in 1.346s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dfb6665d-732b-4b86-a5b5-4f0151e81fa6 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9019682d-a661-47ec-bd54-fdbb5cb917eb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:14 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9019682d-a661-47ec-bd54-fdbb5cb917eb Jul 03 01:13:14 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-53b1b98d-4bef-4fea-97dc-094f5df60b50 tempest-VolumesSnapshotListTestJSON-959609686 None] Acquiring lock "cinder-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-53b1b98d-4bef-4fea-97dc-094f5df60b50 tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "cinder-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-53b1b98d-4bef-4fea-97dc-094f5df60b50 tempest-VolumesSnapshotListTestJSON-959609686 None] Acquiring lock "cinder-quobyte-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-53b1b98d-4bef-4fea-97dc-094f5df60b50 tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "cinder-quobyte-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:15 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d234c7-cd48-4d49-b344-29b7be31c75b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-53b1b98d-4bef-4fea-97dc-094f5df60b50 tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:15 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92 Jul 03 01:13:15 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:15 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dfb6665d-732b-4b86-a5b5-4f0151e81fa6 tempest-VolumeQuotasNegativeTestJSON-370299482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9019682d-a661-47ec-bd54-fdbb5cb917eb" returned: 0 in 1.095s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dfb6665d-732b-4b86-a5b5-4f0151e81fa6 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Lock "cinder-quobyte-9019682d-a661-47ec-bd54-fdbb5cb917eb" released by "delete_volume" :: held 2.523s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:15 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-dfb6665d-732b-4b86-a5b5-4f0151e81fa6 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Created reservations ['23f13815-d6ca-443a-854b-9091db3ad718', 'bed70d20-df96-43d6-9137-98d535c034c1', '96d9d26c-41ed-4f89-a656-ae0921790eae', '4c3382d4-9468-415a-91d2-9d6728e558f4'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:13:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dfb6665d-732b-4b86-a5b5-4f0151e81fa6 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dfb6665d-732b-4b86-a5b5-4f0151e81fa6 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dfb6665d-732b-4b86-a5b5-4f0151e81fa6 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dfb6665d-732b-4b86-a5b5-4f0151e81fa6 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dfb6665d-732b-4b86-a5b5-4f0151e81fa6 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dfb6665d-732b-4b86-a5b5-4f0151e81fa6 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:16 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:13:16 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:16 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-53b1b98d-4bef-4fea-97dc-094f5df60b50 tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92" returned: 0 in 1.277s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-53b1b98d-4bef-4fea-97dc-094f5df60b50 tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:16 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92 Jul 03 01:13:16 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dfb6665d-732b-4b86-a5b5-4f0151e81fa6 tempest-VolumeQuotasNegativeTestJSON-370299482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.325s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:17 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:17 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-dfb6665d-732b-4b86-a5b5-4f0151e81fa6 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:13:17 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-dfb6665d-732b-4b86-a5b5-4f0151e81fa6 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Deleted volume successfully. Jul 03 01:13:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dfb6665d-732b-4b86-a5b5-4f0151e81fa6 tempest-VolumeQuotasNegativeTestJSON-370299482 None] Lock "cinder-9019682d-a661-47ec-bd54-fdbb5cb917eb-delete_volume" released by "delete_volume" :: held 4.321s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:17 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-53b1b98d-4bef-4fea-97dc-094f5df60b50 tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92" returned: 0 in 1.389s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-53b1b98d-4bef-4fea-97dc-094f5df60b50 tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "cinder-quobyte-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92" released by "delete_volume" :: held 2.779s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:18 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-53b1b98d-4bef-4fea-97dc-094f5df60b50 tempest-VolumesSnapshotListTestJSON-959609686 None] Created reservations ['d3e0bfb1-79d9-470f-9719-10d201ac26b8', 'ec0019d1-3882-42e7-9121-a27f7af37242', '1bd13492-2d2c-41f5-84d7-03d1d36d2478', 'ddceb28a-7efc-444e-86d7-7d044f94938f'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:13:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-53b1b98d-4bef-4fea-97dc-094f5df60b50 tempest-VolumesSnapshotListTestJSON-959609686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-53b1b98d-4bef-4fea-97dc-094f5df60b50 tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-53b1b98d-4bef-4fea-97dc-094f5df60b50 tempest-VolumesSnapshotListTestJSON-959609686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-53b1b98d-4bef-4fea-97dc-094f5df60b50 tempest-VolumesSnapshotListTestJSON-959609686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-53b1b98d-4bef-4fea-97dc-094f5df60b50 tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-53b1b98d-4bef-4fea-97dc-094f5df60b50 tempest-VolumesSnapshotListTestJSON-959609686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:18 devstack sudo[98021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:13:18 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:19 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-53b1b98d-4bef-4fea-97dc-094f5df60b50 tempest-VolumesSnapshotListTestJSON-959609686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.321s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:19 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-53b1b98d-4bef-4fea-97dc-094f5df60b50 tempest-VolumesSnapshotListTestJSON-959609686 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:13:19 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-53b1b98d-4bef-4fea-97dc-094f5df60b50 tempest-VolumesSnapshotListTestJSON-959609686 None] Deleted volume successfully. Jul 03 01:13:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-53b1b98d-4bef-4fea-97dc-094f5df60b50 tempest-VolumesSnapshotListTestJSON-959609686 None] Lock "cinder-3bc85c08-14b2-4d2a-aa43-2cdd8a50ca92-delete_volume" released by "delete_volume" :: held 4.492s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:27 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:13:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Flow 'volume_create_manager' (a30feb3d-a06d-4f6b-9444-a0986c3b2435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83f1590-4659-4837-b3c5-047051eb94ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83f1590-4659-4837-b3c5-047051eb94ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-55190818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420dad97-e0f7-46fd-913e-785606c24b27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5696b9263a049bfbe73353769948a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:28Z,use_quota=True,user_id='b6b9e8b960c2499f87a22be08ff5cb18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02634fb3-3412-472e-a0aa-96b5d67ba132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02634fb3-3412-472e-a0aa-96b5d67ba132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c17857-f510-435a-8c83-771736dd84d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c17857-f510-435a-8c83-771736dd84d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '420dad97-e0f7-46fd-913e-785606c24b27', 'volume_name': 'volume-420dad97-e0f7-46fd-913e-785606c24b27', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65f54150-8f9f-42f3-86fc-c3dc7c10dc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65f54150-8f9f-42f3-86fc-c3dc7c10dc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f02ad2-b419-4ed8-8a98-da721023ff6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:27 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Volume 420dad97-e0f7-46fd-913e-785606c24b27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-420dad97-e0f7-46fd-913e-785606c24b27', 'volume_size': 1} Jul 03 01:13:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-55190818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420dad97-e0f7-46fd-913e-785606c24b27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5696b9263a049bfbe73353769948a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:28Z,use_quota=True,user_id='b6b9e8b960c2499f87a22be08ff5cb18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:13:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Creating volume 420dad97-e0f7-46fd-913e-785606c24b27 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:13:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:13:27 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:13:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-420dad97-e0f7-46fd-913e-785606c24b27 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:27 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-420dad97-e0f7-46fd-913e-785606c24b27 1073741824 Jul 03 01:13:27 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:28 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-420dad97-e0f7-46fd-913e-785606c24b27 1073741824" returned: 0 in 0.993s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-420dad97-e0f7-46fd-913e-785606c24b27 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:28 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-420dad97-e0f7-46fd-913e-785606c24b27 Jul 03 01:13:28 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:29 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-420dad97-e0f7-46fd-913e-785606c24b27" returned: 0 in 0.809s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] <== create_volume: return (1865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:13:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f02ad2-b419-4ed8-8a98-da721023ff6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-420dad97-e0f7-46fd-913e-785606c24b27', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c1f272a-f1e7-4111-aee9-233b26fe0808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:29 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Volume volume-420dad97-e0f7-46fd-913e-785606c24b27 (420dad97-e0f7-46fd-913e-785606c24b27): created successfully Jul 03 01:13:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c1f272a-f1e7-4111-aee9-233b26fe0808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Flow 'volume_create_manager' (a30feb3d-a06d-4f6b-9444-a0986c3b2435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:29 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-83df514b-e68f-4084-b5b4-00eb75e674fd tempest-VolumesListAdminTestJSON-317617212 None] Created volume successfully. Jul 03 01:13:31 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:13:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Flow 'volume_create_manager' (c4462aaf-8ddc-4780-8560-597a6b4e61e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c111e07-c38f-41c2-9bed-2b7d1b434e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c111e07-c38f-41c2-9bed-2b7d1b434e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2103403431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84599c14-398f-4c4d-a0d5-ac2db70094c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5696b9263a049bfbe73353769948a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:32Z,use_quota=True,user_id='b6b9e8b960c2499f87a22be08ff5cb18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54c5729-9eac-4678-a811-ff1e30f00f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54c5729-9eac-4678-a811-ff1e30f00f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73be8cb6-e0b4-4ae1-b96a-aade9c2de493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73be8cb6-e0b4-4ae1-b96a-aade9c2de493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84599c14-398f-4c4d-a0d5-ac2db70094c6', 'volume_name': 'volume-84599c14-398f-4c4d-a0d5-ac2db70094c6', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f4cfa2-f43a-4761-a929-4dbc17d8f23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f4cfa2-f43a-4761-a929-4dbc17d8f23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b661655-6187-45bd-9149-607ee04291e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:31 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Volume 84599c14-398f-4c4d-a0d5-ac2db70094c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84599c14-398f-4c4d-a0d5-ac2db70094c6', 'volume_size': 1} Jul 03 01:13:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2103403431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84599c14-398f-4c4d-a0d5-ac2db70094c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5696b9263a049bfbe73353769948a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:32Z,use_quota=True,user_id='b6b9e8b960c2499f87a22be08ff5cb18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:13:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Creating volume 84599c14-398f-4c4d-a0d5-ac2db70094c6 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:13:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:13:31 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:13:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-84599c14-398f-4c4d-a0d5-ac2db70094c6 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:31 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-84599c14-398f-4c4d-a0d5-ac2db70094c6 1073741824 Jul 03 01:13:31 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:32 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-84599c14-398f-4c4d-a0d5-ac2db70094c6 1073741824" returned: 0 in 1.053s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-84599c14-398f-4c4d-a0d5-ac2db70094c6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:32 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-84599c14-398f-4c4d-a0d5-ac2db70094c6 Jul 03 01:13:32 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:33 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-84599c14-398f-4c4d-a0d5-ac2db70094c6" returned: 0 in 0.702s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:13:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b661655-6187-45bd-9149-607ee04291e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84599c14-398f-4c4d-a0d5-ac2db70094c6', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde2c951-07a5-4394-8df4-da6a09543b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:33 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Volume volume-84599c14-398f-4c4d-a0d5-ac2db70094c6 (84599c14-398f-4c4d-a0d5-ac2db70094c6): created successfully Jul 03 01:13:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde2c951-07a5-4394-8df4-da6a09543b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Flow 'volume_create_manager' (c4462aaf-8ddc-4780-8560-597a6b4e61e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:33 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6b4ab94a-e1e3-427b-92fa-ae7c431db2b1 tempest-VolumesListAdminTestJSON-317617212 None] Created volume successfully. Jul 03 01:13:35 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:13:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Flow 'volume_create_manager' (c283211a-709e-4e6e-8ad4-d6ecc36c9bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf36e215-f3eb-467d-aa59-b723e1bfbaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf36e215-f3eb-467d-aa59-b723e1bfbaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-435231021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5696b9263a049bfbe73353769948a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:36Z,use_quota=True,user_id='b6b9e8b960c2499f87a22be08ff5cb18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d784b78d-beec-4052-ab01-16ed8a4673bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d784b78d-beec-4052-ab01-16ed8a4673bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427202fc-2ff2-48c6-9737-85a0c7d5a7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427202fc-2ff2-48c6-9737-85a0c7d5a7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4', 'volume_name': 'volume-f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0803e28e-f381-4f62-b725-18b98f5a3dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0803e28e-f381-4f62-b725-18b98f5a3dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc50bd5-96d0-4ee1-bab3-9df030ce8063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:35 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Volume f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4', 'volume_size': 1} Jul 03 01:13:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-435231021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5696b9263a049bfbe73353769948a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:36Z,use_quota=True,user_id='b6b9e8b960c2499f87a22be08ff5cb18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:13:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Creating volume f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:13:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:13:35 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:13:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:35 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4 1073741824 Jul 03 01:13:35 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:37 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4 1073741824" returned: 0 in 1.298s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:37 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4 Jul 03 01:13:37 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:37 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:13:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Flow 'volume_create_manager' (56acdfc3-c6ec-48b4-9862-36f4f3000186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4625fa6a-40a1-4933-b7ad-4f339d3f2389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4625fa6a-40a1-4933-b7ad-4f339d3f2389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1935904440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d7d122-dd56-4c41-85cd-5ae73f3b1e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb2837b837c46249c815ad7241aac9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:37Z,use_quota=True,user_id='9e8ca460308244ec8f9b71f440683ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf2bcfb-21af-4072-925d-29415a69d5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf2bcfb-21af-4072-925d-29415a69d5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf63c2c1-855f-427b-8403-a6da345f3d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf63c2c1-855f-427b-8403-a6da345f3d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90d7d122-dd56-4c41-85cd-5ae73f3b1e54', 'volume_name': 'volume-90d7d122-dd56-4c41-85cd-5ae73f3b1e54', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b324f6a-16b1-4826-a60b-ba8e2959d29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b324f6a-16b1-4826-a60b-ba8e2959d29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d9b0d1f-8b87-42fa-9406-4a26f2812ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:37 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Volume 90d7d122-dd56-4c41-85cd-5ae73f3b1e54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90d7d122-dd56-4c41-85cd-5ae73f3b1e54', 'volume_size': 1} Jul 03 01:13:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:38 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4" returned: 0 in 0.962s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] <== create_volume: return (2348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:13:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.351s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.562s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1935904440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d7d122-dd56-4c41-85cd-5ae73f3b1e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb2837b837c46249c815ad7241aac9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:37Z,use_quota=True,user_id='9e8ca460308244ec8f9b71f440683ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:13:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Creating volume 90d7d122-dd56-4c41-85cd-5ae73f3b1e54 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:13:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:13:38 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:13:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-90d7d122-dd56-4c41-85cd-5ae73f3b1e54 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:38 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-90d7d122-dd56-4c41-85cd-5ae73f3b1e54 1073741824 Jul 03 01:13:38 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc50bd5-96d0-4ee1-bab3-9df030ce8063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (793bd333-cf8e-4b56-8b18-d92a48ab532a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:38 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Volume volume-f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4 (f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4): created successfully Jul 03 01:13:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (793bd333-cf8e-4b56-8b18-d92a48ab532a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Flow 'volume_create_manager' (c283211a-709e-4e6e-8ad4-d6ecc36c9bf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:38 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6f48fcfc-b0b5-4753-9e2e-9b4ea4f22d73 tempest-VolumesListAdminTestJSON-317617212 None] Created volume successfully. Jul 03 01:13:39 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-90d7d122-dd56-4c41-85cd-5ae73f3b1e54 1073741824" returned: 0 in 1.173s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-90d7d122-dd56-4c41-85cd-5ae73f3b1e54 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:39 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-90d7d122-dd56-4c41-85cd-5ae73f3b1e54 Jul 03 01:13:39 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:39 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:13:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Flow 'volume_create_manager' (501b9b8c-79cc-420c-8fdb-698e85126ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1f5a25-0f27-42ee-81ca-236e4cbaded5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1f5a25-0f27-42ee-81ca-236e4cbaded5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2dc772-47d4-4377-8097-20c413f833c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c056216b9e54295a1a8953cbfb04a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:40Z,use_quota=True,user_id='a0d2b60190c14b00bebcbfb469c7ee3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5718e05-0ea4-420a-916e-b4261ef552b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5718e05-0ea4-420a-916e-b4261ef552b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476219bd-fa0f-40f5-94ec-594acc41b98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476219bd-fa0f-40f5-94ec-594acc41b98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e2dc772-47d4-4377-8097-20c413f833c6', 'volume_name': 'volume-5e2dc772-47d4-4377-8097-20c413f833c6', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc7c682-1ecc-4555-b754-23ea06f478b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc7c682-1ecc-4555-b754-23ea06f478b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de70a318-f380-4b8a-acec-5d1c8ca0d0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:40 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Volume 5e2dc772-47d4-4377-8097-20c413f833c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e2dc772-47d4-4377-8097-20c413f833c6', 'volume_size': 1} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Flow 'volume_create_manager' (6e172645-2347-459c-8b00-e332c94d4284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45fbd3ad-34a3-45d0-9efe-7d2ab612cda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45fbd3ad-34a3-45d0-9efe-7d2ab612cda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1708427272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620574b0-2e40-4fed-b0eb-b6f05b43b214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f10a8943a2dd4a509402e63683b2beac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:40Z,use_quota=True,user_id='c0ef64630a414bcda50a954f64285b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a731f6ce-ffc4-4fba-96e0-f9c88cac8e92),volume_type_id=a731f6ce-ffc4-4fba-96e0-f9c88cac8e92)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e2fc4b-d7c4-4633-bd10-2e1aeca3b14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e2fc4b-d7c4-4633-bd10-2e1aeca3b14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8f9acd-9b50-45ab-a6cb-cfa3c17aa189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8f9acd-9b50-45ab-a6cb-cfa3c17aa189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '620574b0-2e40-4fed-b0eb-b6f05b43b214', 'volume_name': 'volume-620574b0-2e40-4fed-b0eb-b6f05b43b214', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (112291d0-7bb4-4f14-a2ad-12a9e56e18a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (112291d0-7bb4-4f14-a2ad-12a9e56e18a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (267a5f9b-13e8-4595-af9f-b3e9f7e65f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:40 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Volume 620574b0-2e40-4fed-b0eb-b6f05b43b214: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-620574b0-2e40-4fed-b0eb-b6f05b43b214', 'volume_size': 1} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:40 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-90d7d122-dd56-4c41-85cd-5ae73f3b1e54" returned: 0 in 0.988s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] <== create_volume: return (2221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.224s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.292s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2dc772-47d4-4377-8097-20c413f833c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c056216b9e54295a1a8953cbfb04a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:40Z,use_quota=True,user_id='a0d2b60190c14b00bebcbfb469c7ee3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Creating volume 5e2dc772-47d4-4377-8097-20c413f833c6 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:13:40 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e2dc772-47d4-4377-8097-20c413f833c6 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d9b0d1f-8b87-42fa-9406-4a26f2812ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90d7d122-dd56-4c41-85cd-5ae73f3b1e54', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:40 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e2dc772-47d4-4377-8097-20c413f833c6 1073741824 Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907c7076-3b86-436c-86df-385517096c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:40 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:40 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Volume volume-90d7d122-dd56-4c41-85cd-5ae73f3b1e54 (90d7d122-dd56-4c41-85cd-5ae73f3b1e54): created successfully Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907c7076-3b86-436c-86df-385517096c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Flow 'volume_create_manager' (56acdfc3-c6ec-48b4-9862-36f4f3000186) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:40 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4bbc435f-af4a-4cb4-9e11-161d1e2c6e9e tempest-AttachVolumeTestJSON-1781287949 None] Created volume successfully. Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Flow 'volume_create_manager' (4900b17e-8c14-4fe9-adf1-beb1623857a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaab0c83-12e7-4431-99b9-64c3cad5d10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaab0c83-12e7-4431-99b9-64c3cad5d10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-958110306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=716d9866-9ed6-48da-a674-79333be076df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f10a8943a2dd4a509402e63683b2beac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:40Z,use_quota=True,user_id='c0ef64630a414bcda50a954f64285b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc9b117-91d6-4b72-b565-8dc819d21947),volume_type_id=7fc9b117-91d6-4b72-b565-8dc819d21947)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f5da34d-5b9e-466e-8187-6ecd862202f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f5da34d-5b9e-466e-8187-6ecd862202f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1105143c-288b-4d4b-8f24-0bd12e8ac928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1105143c-288b-4d4b-8f24-0bd12e8ac928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '716d9866-9ed6-48da-a674-79333be076df', 'volume_name': 'volume-716d9866-9ed6-48da-a674-79333be076df', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ede442-2a18-488c-ada8-61850618fb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ede442-2a18-488c-ada8-61850618fb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b88abae-f97c-48df-9910-92f046e5284a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:40 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Volume 716d9866-9ed6-48da-a674-79333be076df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-716d9866-9ed6-48da-a674-79333be076df', 'volume_size': 1} Jul 03 01:13:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:41 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:13:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Flow 'volume_create_manager' (372e75be-b6ae-4740-976f-c8685687e40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7bc2a67-8f78-41bb-97f5-797c83cce4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7bc2a67-8f78-41bb-97f5-797c83cce4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2044541810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=633c26e0-badc-4109-b017-b654fa8f1d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f10a8943a2dd4a509402e63683b2beac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:41Z,use_quota=True,user_id='c0ef64630a414bcda50a954f64285b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4e7813c-a125-4b13-9af4-84503513250c),volume_type_id=b4e7813c-a125-4b13-9af4-84503513250c)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (809c07e6-981b-46ee-8096-6bce36d6a38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (809c07e6-981b-46ee-8096-6bce36d6a38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d12a44-144c-447d-bf0d-f0454b6920e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:41 devstack cinder-volume[86772]: DEBUG cinder.image.glance [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Creating Keystone auth plugin from conf {{(pid=86772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 01:13:41 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e2dc772-47d4-4377-8097-20c413f833c6 1073741824" returned: 0 in 1.355s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d12a44-144c-447d-bf0d-f0454b6920e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '633c26e0-badc-4109-b017-b654fa8f1d27', 'volume_name': 'volume-633c26e0-badc-4109-b017-b654fa8f1d27', 'volume_size': 1, 'image_id': '53ee9a34-e59a-447a-8f99-0e740022d81d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/53ee9a34-e59a-447a-8f99-0e740022d81d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1286211365', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f10a8943a2dd4a509402e63683b2beac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '53ee9a34-e59a-447a-8f99-0e740022d81d', 'created_at': datetime.datetime(2026, 7, 2, 23, 13, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 13, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/53ee9a34-e59a-447a-8f99-0e740022d81d/file', 'properties': {}}, 'image_service': }' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (226bf9f0-d5fc-47d3-aad3-c8546548d42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (226bf9f0-d5fc-47d3-aad3-c8546548d42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c62392e-e324-4d39-b9d3-d3a95f66a4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:41 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Volume 633c26e0-badc-4109-b017-b654fa8f1d27: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-633c26e0-badc-4109-b017-b654fa8f1d27', 'volume_size': 1, 'image_id': '53ee9a34-e59a-447a-8f99-0e740022d81d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/53ee9a34-e59a-447a-8f99-0e740022d81d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1286211365', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f10a8943a2dd4a509402e63683b2beac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '53ee9a34-e59a-447a-8f99-0e740022d81d', 'created_at': datetime.datetime(2026, 7, 2, 23, 13, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 13, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/53ee9a34-e59a-447a-8f99-0e740022d81d/file', 'properties': {}}, 'image_service': } Jul 03 01:13:41 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Trying to clone 633c26e0-badc-4109-b017-b654fa8f1d27 from image 53ee9a34-e59a-447a-8f99-0e740022d81d at location (None, [{'url': 'file:///opt/stack/data/glance/images/53ee9a34-e59a-447a-8f99-0e740022d81d', 'metadata': {}}]). {{(pid=86772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 01:13:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e2dc772-47d4-4377-8097-20c413f833c6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:41 devstack sudo[98111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e2dc772-47d4-4377-8097-20c413f833c6 Jul 03 01:13:41 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:42 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e2dc772-47d4-4377-8097-20c413f833c6" returned: 0 in 0.907s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] <== create_volume: return (2355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:13:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.358s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.559s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1708427272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620574b0-2e40-4fed-b0eb-b6f05b43b214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f10a8943a2dd4a509402e63683b2beac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:40Z,use_quota=True,user_id='c0ef64630a414bcda50a954f64285b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a731f6ce-ffc4-4fba-96e0-f9c88cac8e92),volume_type_id=a731f6ce-ffc4-4fba-96e0-f9c88cac8e92)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:13:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Creating volume 620574b0-2e40-4fed-b0eb-b6f05b43b214 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:13:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:13:42 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:13:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-620574b0-2e40-4fed-b0eb-b6f05b43b214 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de70a318-f380-4b8a-acec-5d1c8ca0d0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e2dc772-47d4-4377-8097-20c413f833c6', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:42 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-620574b0-2e40-4fed-b0eb-b6f05b43b214 1073741824 Jul 03 01:13:42 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4da46dd-e859-4886-9e14-d09c4f8bed15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:42 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Volume volume-5e2dc772-47d4-4377-8097-20c413f833c6 (5e2dc772-47d4-4377-8097-20c413f833c6): created successfully Jul 03 01:13:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4da46dd-e859-4886-9e14-d09c4f8bed15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Flow 'volume_create_manager' (501b9b8c-79cc-420c-8fdb-698e85126ae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:42 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-30f5721a-8278-4ef2-b4d7-edbb50e2a2b3 tempest-VolumesListAdminTestJSON-2073149277 None] Created volume successfully. Jul 03 01:13:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0e3d25a1-0814-4ef2-9c95-14467626373e tempest-VolumesListAdminTestJSON-2073149277 None] Acquiring lock "cinder-5e2dc772-47d4-4377-8097-20c413f833c6-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0e3d25a1-0814-4ef2-9c95-14467626373e tempest-VolumesListAdminTestJSON-2073149277 None] Lock "cinder-5e2dc772-47d4-4377-8097-20c413f833c6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0e3d25a1-0814-4ef2-9c95-14467626373e tempest-VolumesListAdminTestJSON-2073149277 None] Acquiring lock "cinder-quobyte-5e2dc772-47d4-4377-8097-20c413f833c6" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0e3d25a1-0814-4ef2-9c95-14467626373e tempest-VolumesListAdminTestJSON-2073149277 None] Lock "cinder-quobyte-5e2dc772-47d4-4377-8097-20c413f833c6" acquired by "delete_volume" :: waited 0.043s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:43 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42d409a-366b-4971-a7d1-f9b170a6273d]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0e3d25a1-0814-4ef2-9c95-14467626373e tempest-VolumesListAdminTestJSON-2073149277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e2dc772-47d4-4377-8097-20c413f833c6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e49b2a78-4ca9-4f47-b049-f2e3920b4bee tempest-VolumesListAdminTestJSON-317617212 None] Acquiring lock "cinder-f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e49b2a78-4ca9-4f47-b049-f2e3920b4bee tempest-VolumesListAdminTestJSON-317617212 None] Lock "cinder-f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:43 devstack sudo[98116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e2dc772-47d4-4377-8097-20c413f833c6 Jul 03 01:13:43 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e49b2a78-4ca9-4f47-b049-f2e3920b4bee tempest-VolumesListAdminTestJSON-317617212 None] Acquiring lock "cinder-quobyte-f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e49b2a78-4ca9-4f47-b049-f2e3920b4bee tempest-VolumesListAdminTestJSON-317617212 None] Lock "cinder-quobyte-f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4" acquired by "delete_volume" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:43 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[796f7fa6-fbe8-4671-b84a-cfae211344fd]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e49b2a78-4ca9-4f47-b049-f2e3920b4bee tempest-VolumesListAdminTestJSON-317617212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:43 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4 Jul 03 01:13:43 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:43 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-620574b0-2e40-4fed-b0eb-b6f05b43b214 1073741824" returned: 0 in 1.301s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-620574b0-2e40-4fed-b0eb-b6f05b43b214 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:44 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-620574b0-2e40-4fed-b0eb-b6f05b43b214 Jul 03 01:13:44 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-f8da6b0d-3b50-437e-b795-2dc0bc66e364 req-8ef5f4fa-3d51-44ad-82de-8bcf019dd888 tempest-AttachVolumeTestJSON-1781287949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:44 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0e3d25a1-0814-4ef2-9c95-14467626373e tempest-VolumesListAdminTestJSON-2073149277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e2dc772-47d4-4377-8097-20c413f833c6" returned: 0 in 1.312s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0e3d25a1-0814-4ef2-9c95-14467626373e tempest-VolumesListAdminTestJSON-2073149277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e2dc772-47d4-4377-8097-20c413f833c6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:44 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e2dc772-47d4-4377-8097-20c413f833c6 Jul 03 01:13:44 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:45 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e49b2a78-4ca9-4f47-b049-f2e3920b4bee tempest-VolumesListAdminTestJSON-317617212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4" returned: 0 in 1.348s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e49b2a78-4ca9-4f47-b049-f2e3920b4bee tempest-VolumesListAdminTestJSON-317617212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:45 devstack sudo[98143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4 Jul 03 01:13:45 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:45 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-620574b0-2e40-4fed-b0eb-b6f05b43b214" returned: 0 in 1.195s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] <== create_volume: return (2603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:13:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.611s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.678s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-958110306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=716d9866-9ed6-48da-a674-79333be076df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f10a8943a2dd4a509402e63683b2beac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:40Z,use_quota=True,user_id='c0ef64630a414bcda50a954f64285b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc9b117-91d6-4b72-b565-8dc819d21947),volume_type_id=7fc9b117-91d6-4b72-b565-8dc819d21947)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:13:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Creating volume 716d9866-9ed6-48da-a674-79333be076df {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:13:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:13:45 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:13:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-716d9866-9ed6-48da-a674-79333be076df 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (267a5f9b-13e8-4595-af9f-b3e9f7e65f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-620574b0-2e40-4fed-b0eb-b6f05b43b214', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1a9d83-21c2-4ac1-b9f6-1f3344c60c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:45 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-716d9866-9ed6-48da-a674-79333be076df 1073741824 Jul 03 01:13:45 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:45 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Volume volume-620574b0-2e40-4fed-b0eb-b6f05b43b214 (620574b0-2e40-4fed-b0eb-b6f05b43b214): created successfully Jul 03 01:13:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1a9d83-21c2-4ac1-b9f6-1f3344c60c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Flow 'volume_create_manager' (6e172645-2347-459c-8b00-e332c94d4284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:45 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6b5d4203-d627-43eb-84d0-d2d852af788c tempest-TestInstancesWithCinderVolumes-1251159148 None] Created volume successfully. Jul 03 01:13:45 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0e3d25a1-0814-4ef2-9c95-14467626373e tempest-VolumesListAdminTestJSON-2073149277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e2dc772-47d4-4377-8097-20c413f833c6" returned: 0 in 1.097s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0e3d25a1-0814-4ef2-9c95-14467626373e tempest-VolumesListAdminTestJSON-2073149277 None] Lock "cinder-quobyte-5e2dc772-47d4-4377-8097-20c413f833c6" released by "delete_volume" :: held 2.491s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:45 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-0e3d25a1-0814-4ef2-9c95-14467626373e tempest-VolumesListAdminTestJSON-2073149277 None] Created reservations ['390fdd3a-239f-4188-9d8c-f004f7303112', '879fc435-d9b3-4623-8b8a-0a0efaa207c5', 'ca2321df-b96b-4548-ba7f-5f72257dcfc7', '340642d4-7df1-40b8-8842-164a1f293ffd'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:13:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0e3d25a1-0814-4ef2-9c95-14467626373e tempest-VolumesListAdminTestJSON-2073149277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0e3d25a1-0814-4ef2-9c95-14467626373e tempest-VolumesListAdminTestJSON-2073149277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0e3d25a1-0814-4ef2-9c95-14467626373e tempest-VolumesListAdminTestJSON-2073149277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0e3d25a1-0814-4ef2-9c95-14467626373e tempest-VolumesListAdminTestJSON-2073149277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0e3d25a1-0814-4ef2-9c95-14467626373e tempest-VolumesListAdminTestJSON-2073149277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0e3d25a1-0814-4ef2-9c95-14467626373e tempest-VolumesListAdminTestJSON-2073149277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:46 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e49b2a78-4ca9-4f47-b049-f2e3920b4bee tempest-VolumesListAdminTestJSON-317617212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4" returned: 0 in 1.066s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:46 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:13:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e49b2a78-4ca9-4f47-b049-f2e3920b4bee tempest-VolumesListAdminTestJSON-317617212 None] Lock "cinder-quobyte-f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4" released by "delete_volume" :: held 2.484s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:46 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:46 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e49b2a78-4ca9-4f47-b049-f2e3920b4bee tempest-VolumesListAdminTestJSON-317617212 None] Created reservations ['5c1a67e4-407b-4d93-a5cd-0d3b18f1ce89', 'd29cc09c-c674-43ac-bb10-4f241e67aa45', '0809acc6-b042-4b49-819d-9b5afa57055c', '6a047136-f4b8-4bf6-b54c-8eb6ee414fa1'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:13:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e49b2a78-4ca9-4f47-b049-f2e3920b4bee tempest-VolumesListAdminTestJSON-317617212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e49b2a78-4ca9-4f47-b049-f2e3920b4bee tempest-VolumesListAdminTestJSON-317617212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e49b2a78-4ca9-4f47-b049-f2e3920b4bee tempest-VolumesListAdminTestJSON-317617212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e49b2a78-4ca9-4f47-b049-f2e3920b4bee tempest-VolumesListAdminTestJSON-317617212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e49b2a78-4ca9-4f47-b049-f2e3920b4bee tempest-VolumesListAdminTestJSON-317617212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e49b2a78-4ca9-4f47-b049-f2e3920b4bee tempest-VolumesListAdminTestJSON-317617212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:46 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:13:46 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:46 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-716d9866-9ed6-48da-a674-79333be076df 1073741824" returned: 0 in 1.124s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-716d9866-9ed6-48da-a674-79333be076df {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:46 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-716d9866-9ed6-48da-a674-79333be076df Jul 03 01:13:46 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:47 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0e3d25a1-0814-4ef2-9c95-14467626373e tempest-VolumesListAdminTestJSON-2073149277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.037s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:47 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-0e3d25a1-0814-4ef2-9c95-14467626373e tempest-VolumesListAdminTestJSON-2073149277 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:13:47 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-0e3d25a1-0814-4ef2-9c95-14467626373e tempest-VolumesListAdminTestJSON-2073149277 None] Deleted volume successfully. Jul 03 01:13:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ca21c137-280d-497a-8c34-ba61f2bfef66 tempest-VolumesListAdminTestJSON-317617212 None] Acquiring lock "cinder-84599c14-398f-4c4d-a0d5-ac2db70094c6-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0e3d25a1-0814-4ef2-9c95-14467626373e tempest-VolumesListAdminTestJSON-2073149277 None] Lock "cinder-5e2dc772-47d4-4377-8097-20c413f833c6-delete_volume" released by "delete_volume" :: held 3.930s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ca21c137-280d-497a-8c34-ba61f2bfef66 tempest-VolumesListAdminTestJSON-317617212 None] Lock "cinder-84599c14-398f-4c4d-a0d5-ac2db70094c6-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ca21c137-280d-497a-8c34-ba61f2bfef66 tempest-VolumesListAdminTestJSON-317617212 None] Acquiring lock "cinder-quobyte-84599c14-398f-4c4d-a0d5-ac2db70094c6" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ca21c137-280d-497a-8c34-ba61f2bfef66 tempest-VolumesListAdminTestJSON-317617212 None] Lock "cinder-quobyte-84599c14-398f-4c4d-a0d5-ac2db70094c6" acquired by "delete_volume" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:47 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e49b2a78-4ca9-4f47-b049-f2e3920b4bee tempest-VolumesListAdminTestJSON-317617212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.066s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:47 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-e49b2a78-4ca9-4f47-b049-f2e3920b4bee tempest-VolumesListAdminTestJSON-317617212 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:13:47 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e49b2a78-4ca9-4f47-b049-f2e3920b4bee tempest-VolumesListAdminTestJSON-317617212 None] Deleted volume successfully. Jul 03 01:13:47 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d69fa4-7924-42ce-aad1-c9b74e00557d]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ca21c137-280d-497a-8c34-ba61f2bfef66 tempest-VolumesListAdminTestJSON-317617212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-84599c14-398f-4c4d-a0d5-ac2db70094c6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e49b2a78-4ca9-4f47-b049-f2e3920b4bee tempest-VolumesListAdminTestJSON-317617212 None] Lock "cinder-f3f0691f-39c9-44cd-9e2b-ff9d3539e2d4-delete_volume" released by "delete_volume" :: held 3.902s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:47 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-84599c14-398f-4c4d-a0d5-ac2db70094c6 Jul 03 01:13:47 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:47 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-716d9866-9ed6-48da-a674-79333be076df" returned: 0 in 1.050s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] <== create_volume: return (2237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:13:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.240s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-f8da6b0d-3b50-437e-b795-2dc0bc66e364 req-8ef5f4fa-3d51-44ad-82de-8bcf019dd888 tempest-AttachVolumeTestJSON-1781287949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.287s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b88abae-f97c-48df-9910-92f046e5284a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-716d9866-9ed6-48da-a674-79333be076df', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829e981c-e706-4f62-afd4-b2d93f56d673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:47 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06c30d4-ccfe-458e-b745-28a775df117f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-f8da6b0d-3b50-437e-b795-2dc0bc66e364 req-8ef5f4fa-3d51-44ad-82de-8bcf019dd888 tempest-AttachVolumeTestJSON-1781287949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-90d7d122-dd56-4c41-85cd-5ae73f3b1e54 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:47 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Volume volume-716d9866-9ed6-48da-a674-79333be076df (716d9866-9ed6-48da-a674-79333be076df): created successfully Jul 03 01:13:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829e981c-e706-4f62-afd4-b2d93f56d673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Flow 'volume_create_manager' (4900b17e-8c14-4fe9-adf1-beb1623857a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:47 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-292c3221-27ad-4dc0-ac1c-2332125718b9 tempest-TestInstancesWithCinderVolumes-1251159148 None] Created volume successfully. Jul 03 01:13:47 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-90d7d122-dd56-4c41-85cd-5ae73f3b1e54 Jul 03 01:13:47 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:48 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_53ee9a34-e59a-447a-8f99-0e740022d81d__8dkdghpdevstack@QuobyteHD, size 20.69 MB, duration 6.31 sec {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 01:13:48 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Image download 20.69 MB at 3.28 MB/s Jul 03 01:13:48 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6aa5d3-2ab9-48b5-9233-0798ca878584]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53ee9a34-e59a-447a-8f99-0e740022d81d__8dkdghpdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:48 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53ee9a34-e59a-447a-8f99-0e740022d81d__8dkdghpdevstack@QuobyteHD Jul 03 01:13:48 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:48 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ca21c137-280d-497a-8c34-ba61f2bfef66 tempest-VolumesListAdminTestJSON-317617212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-84599c14-398f-4c4d-a0d5-ac2db70094c6" returned: 0 in 1.192s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ca21c137-280d-497a-8c34-ba61f2bfef66 tempest-VolumesListAdminTestJSON-317617212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-84599c14-398f-4c4d-a0d5-ac2db70094c6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:48 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-84599c14-398f-4c4d-a0d5-ac2db70094c6 Jul 03 01:13:48 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:48 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-f8da6b0d-3b50-437e-b795-2dc0bc66e364 req-8ef5f4fa-3d51-44ad-82de-8bcf019dd888 tempest-AttachVolumeTestJSON-1781287949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-90d7d122-dd56-4c41-85cd-5ae73f3b1e54" returned: 0 in 1.414s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-f8da6b0d-3b50-437e-b795-2dc0bc66e364 req-8ef5f4fa-3d51-44ad-82de-8bcf019dd888 tempest-AttachVolumeTestJSON-1781287949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.446s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-f8da6b0d-3b50-437e-b795-2dc0bc66e364 req-8ef5f4fa-3d51-44ad-82de-8bcf019dd888 tempest-AttachVolumeTestJSON-1781287949 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171', 'name': 'volume-90d7d122-dd56-4c41-85cd-5ae73f3b1e54', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cd1690cf-d3ab-4aec-b60b-3581cd45f148', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:13:49 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-f8da6b0d-3b50-437e-b795-2dc0bc66e364 req-8ef5f4fa-3d51-44ad-82de-8bcf019dd888 tempest-AttachVolumeTestJSON-1781287949 None] attachment_update completed successfully. Jul 03 01:13:49 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53ee9a34-e59a-447a-8f99-0e740022d81d__8dkdghpdevstack@QuobyteHD" returned: 0 in 1.092s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:49 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Temporary image 53ee9a34-e59a-447a-8f99-0e740022d81d is fetched for user c0ef64630a414bcda50a954f64285b68. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 01:13:49 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe55dd7-272c-43c3-b9a6-3a201c60b63c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53ee9a34-e59a-447a-8f99-0e740022d81d__8dkdghpdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:49 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53ee9a34-e59a-447a-8f99-0e740022d81d__8dkdghpdevstack@QuobyteHD Jul 03 01:13:49 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:49 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ca21c137-280d-497a-8c34-ba61f2bfef66 tempest-VolumesListAdminTestJSON-317617212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-84599c14-398f-4c4d-a0d5-ac2db70094c6" returned: 0 in 0.968s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ca21c137-280d-497a-8c34-ba61f2bfef66 tempest-VolumesListAdminTestJSON-317617212 None] Lock "cinder-quobyte-84599c14-398f-4c4d-a0d5-ac2db70094c6" released by "delete_volume" :: held 2.231s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:49 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-ca21c137-280d-497a-8c34-ba61f2bfef66 tempest-VolumesListAdminTestJSON-317617212 None] Created reservations ['ab466ba0-9bf9-4ad3-9b35-58e544c158b5', 'd952d69f-85af-4e32-81b5-8bf823fb7104', '13925ba7-61de-466b-a7fd-ec7f73047d98', '75420f50-937f-409a-a502-447e9ccf759c'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:13:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ca21c137-280d-497a-8c34-ba61f2bfef66 tempest-VolumesListAdminTestJSON-317617212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ca21c137-280d-497a-8c34-ba61f2bfef66 tempest-VolumesListAdminTestJSON-317617212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ca21c137-280d-497a-8c34-ba61f2bfef66 tempest-VolumesListAdminTestJSON-317617212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ca21c137-280d-497a-8c34-ba61f2bfef66 tempest-VolumesListAdminTestJSON-317617212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ca21c137-280d-497a-8c34-ba61f2bfef66 tempest-VolumesListAdminTestJSON-317617212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ca21c137-280d-497a-8c34-ba61f2bfef66 tempest-VolumesListAdminTestJSON-317617212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:49 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:13:49 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:50 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53ee9a34-e59a-447a-8f99-0e740022d81d__8dkdghpdevstack@QuobyteHD" returned: 0 in 0.831s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2044541810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=633c26e0-badc-4109-b017-b654fa8f1d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f10a8943a2dd4a509402e63683b2beac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:41Z,use_quota=True,user_id='c0ef64630a414bcda50a954f64285b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4e7813c-a125-4b13-9af4-84503513250c),volume_type_id=b4e7813c-a125-4b13-9af4-84503513250c)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:13:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Creating volume 633c26e0-badc-4109-b017-b654fa8f1d27 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:13:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:13:50 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:13:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:50 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27 1073741824 Jul 03 01:13:50 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:50 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ca21c137-280d-497a-8c34-ba61f2bfef66 tempest-VolumesListAdminTestJSON-317617212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.860s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:50 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-ca21c137-280d-497a-8c34-ba61f2bfef66 tempest-VolumesListAdminTestJSON-317617212 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:13:50 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ca21c137-280d-497a-8c34-ba61f2bfef66 tempest-VolumesListAdminTestJSON-317617212 None] Deleted volume successfully. Jul 03 01:13:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ca21c137-280d-497a-8c34-ba61f2bfef66 tempest-VolumesListAdminTestJSON-317617212 None] Lock "cinder-84599c14-398f-4c4d-a0d5-ac2db70094c6-delete_volume" released by "delete_volume" :: held 3.356s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c2b6bd99-d1f9-4b22-873a-9324b7c21ea2 tempest-VolumesListAdminTestJSON-317617212 None] Acquiring lock "cinder-420dad97-e0f7-46fd-913e-785606c24b27-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c2b6bd99-d1f9-4b22-873a-9324b7c21ea2 tempest-VolumesListAdminTestJSON-317617212 None] Lock "cinder-420dad97-e0f7-46fd-913e-785606c24b27-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c2b6bd99-d1f9-4b22-873a-9324b7c21ea2 tempest-VolumesListAdminTestJSON-317617212 None] Acquiring lock "cinder-quobyte-420dad97-e0f7-46fd-913e-785606c24b27" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:13:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c2b6bd99-d1f9-4b22-873a-9324b7c21ea2 tempest-VolumesListAdminTestJSON-317617212 None] Lock "cinder-quobyte-420dad97-e0f7-46fd-913e-785606c24b27" acquired by "delete_volume" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:13:50 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e19a54c-5865-4d6c-9a2a-2dfdb94e3b49]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c2b6bd99-d1f9-4b22-873a-9324b7c21ea2 tempest-VolumesListAdminTestJSON-317617212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-420dad97-e0f7-46fd-913e-785606c24b27 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:51 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-420dad97-e0f7-46fd-913e-785606c24b27 Jul 03 01:13:51 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:51 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27 1073741824" returned: 0 in 1.133s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:51 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27 Jul 03 01:13:51 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:51 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c2b6bd99-d1f9-4b22-873a-9324b7c21ea2 tempest-VolumesListAdminTestJSON-317617212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-420dad97-e0f7-46fd-913e-785606c24b27" returned: 0 in 1.148s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c2b6bd99-d1f9-4b22-873a-9324b7c21ea2 tempest-VolumesListAdminTestJSON-317617212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-420dad97-e0f7-46fd-913e-785606c24b27 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:51 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-420dad97-e0f7-46fd-913e-785606c24b27 Jul 03 01:13:51 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:52 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27" returned: 0 in 0.869s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] <== create_volume: return (2079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:13:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:52 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Attempting download of 53ee9a34-e59a-447a-8f99-0e740022d81d ((None, [{'url': 'file:///opt/stack/data/glance/images/53ee9a34-e59a-447a-8f99-0e740022d81d', 'metadata': {}}])) to volume 633c26e0-badc-4109-b017-b654fa8f1d27. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 01:13:52 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbf9e58-1e24-4dc7-825f-32a1b69125f8]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_53ee9a34-e59a-447a-8f99-0e740022d81d_abpp4ey6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:52 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_53ee9a34-e59a-447a-8f99-0e740022d81d_abpp4ey6 Jul 03 01:13:52 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:52 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c2b6bd99-d1f9-4b22-873a-9324b7c21ea2 tempest-VolumesListAdminTestJSON-317617212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-420dad97-e0f7-46fd-913e-785606c24b27" returned: 0 in 0.849s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c2b6bd99-d1f9-4b22-873a-9324b7c21ea2 tempest-VolumesListAdminTestJSON-317617212 None] Lock "cinder-quobyte-420dad97-e0f7-46fd-913e-785606c24b27" released by "delete_volume" :: held 2.043s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:52 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-c2b6bd99-d1f9-4b22-873a-9324b7c21ea2 tempest-VolumesListAdminTestJSON-317617212 None] Created reservations ['a3a0d390-4e71-4805-b5e8-b9b37a6ed7ed', '90d21817-8cac-49a2-bd1b-fd3b9500cf9c', 'dca6aa22-344e-4a21-ae5d-b60de1882e0a', '0ad5465e-0b20-4cf1-aaeb-cb4dcba4391a'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:13:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c2b6bd99-d1f9-4b22-873a-9324b7c21ea2 tempest-VolumesListAdminTestJSON-317617212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c2b6bd99-d1f9-4b22-873a-9324b7c21ea2 tempest-VolumesListAdminTestJSON-317617212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c2b6bd99-d1f9-4b22-873a-9324b7c21ea2 tempest-VolumesListAdminTestJSON-317617212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c2b6bd99-d1f9-4b22-873a-9324b7c21ea2 tempest-VolumesListAdminTestJSON-317617212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c2b6bd99-d1f9-4b22-873a-9324b7c21ea2 tempest-VolumesListAdminTestJSON-317617212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c2b6bd99-d1f9-4b22-873a-9324b7c21ea2 tempest-VolumesListAdminTestJSON-317617212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:52 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:13:52 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:53 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_53ee9a34-e59a-447a-8f99-0e740022d81d_abpp4ey6" returned: 0 in 0.823s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53ee9a34-e59a-447a-8f99-0e740022d81d_abpp4ey6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:53 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53ee9a34-e59a-447a-8f99-0e740022d81d_abpp4ey6 Jul 03 01:13:53 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:53 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c2b6bd99-d1f9-4b22-873a-9324b7c21ea2 tempest-VolumesListAdminTestJSON-317617212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.955s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:53 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-c2b6bd99-d1f9-4b22-873a-9324b7c21ea2 tempest-VolumesListAdminTestJSON-317617212 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:13:53 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c2b6bd99-d1f9-4b22-873a-9324b7c21ea2 tempest-VolumesListAdminTestJSON-317617212 None] Deleted volume successfully. Jul 03 01:13:53 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53ee9a34-e59a-447a-8f99-0e740022d81d_abpp4ey6" returned: 1 in 0.832s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_53ee9a34-e59a-447a-8f99-0e740022d81d_abpp4ey6' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:13:53 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f84c189-e6aa-4de2-af31-f01201e74776]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53ee9a34-e59a-447a-8f99-0e740022d81d__8dkdghpdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c2b6bd99-d1f9-4b22-873a-9324b7c21ea2 tempest-VolumesListAdminTestJSON-317617212 None] Lock "cinder-420dad97-e0f7-46fd-913e-785606c24b27-delete_volume" released by "delete_volume" :: held 3.337s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:13:54 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53ee9a34-e59a-447a-8f99-0e740022d81d__8dkdghpdevstack@QuobyteHD Jul 03 01:13:54 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:54 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_53ee9a34-e59a-447a-8f99-0e740022d81d__8dkdghpdevstack@QuobyteHD" returned: 0 in 0.828s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:54 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] 53ee9a34-e59a-447a-8f99-0e740022d81d was qcow2, converting to raw {{(pid=86772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 01:13:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_53ee9a34-e59a-447a-8f99-0e740022d81d__8dkdghpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:54 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_53ee9a34-e59a-447a-8f99-0e740022d81d__8dkdghpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27 Jul 03 01:13:54 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:54 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:13:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Flow 'volume_create_manager' (d452c4bb-722f-4d46-9e9e-918343836ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da20b0a-7063-469f-bcca-7e088ef1af7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da20b0a-7063-469f-bcca-7e088ef1af7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-181265841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb2837b837c46249c815ad7241aac9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:55Z,use_quota=True,user_id='9e8ca460308244ec8f9b71f440683ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0803f159-11f8-4527-827f-67cb531cb23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0803f159-11f8-4527-827f-67cb531cb23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a15331-d0a0-4683-a541-85c829051ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a15331-d0a0-4683-a541-85c829051ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91', 'volume_name': 'volume-6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d512d0d-73da-4f05-977c-b20d9b1e974f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d512d0d-73da-4f05-977c-b20d9b1e974f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e578b0-c340-4611-9f50-20a265d95e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:54 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Volume 6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91', 'volume_size': 1} Jul 03 01:13:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-181265841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb2837b837c46249c815ad7241aac9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:13:55Z,use_quota=True,user_id='9e8ca460308244ec8f9b71f440683ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:13:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Creating volume 6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:13:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:13:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:13:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:13:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:13:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:13:54 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:13:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:55 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91 1073741824 Jul 03 01:13:55 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:56 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91 1073741824" returned: 0 in 1.198s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:56 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91 Jul 03 01:13:56 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:57 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91" returned: 0 in 0.982s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] <== create_volume: return (2252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:13:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.255s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:13:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e578b0-c340-4611-9f50-20a265d95e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f643c6-9758-4eaf-b80d-4e068364a92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:13:57 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Volume volume-6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91 (6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91): created successfully Jul 03 01:13:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f643c6-9758-4eaf-b80d-4e068364a92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:13:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Flow 'volume_create_manager' (d452c4bb-722f-4d46-9e9e-918343836ce5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:13:57 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-430a5d92-28f3-472f-97bd-923f7b9b39c8 tempest-AttachVolumeTestJSON-1781287949 None] Created volume successfully. Jul 03 01:13:57 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_53ee9a34-e59a-447a-8f99-0e740022d81d__8dkdghpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27" returned: 0 in 2.718s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:57 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_53ee9a34-e59a-447a-8f99-0e740022d81d__8dkdghpdevstack@QuobyteHD, size 112.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27 {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:13:57 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Converted 112.00 MB image at 41.19 MB/s Jul 03 01:13:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:57 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27 1G Jul 03 01:13:57 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:58 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27 1G" returned: 0 in 0.942s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:58 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e3cbea-fa4e-45ac-b1bd-c4e8ecf375a3]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:13:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:58 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27 Jul 03 01:13:58 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:13:59 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Jul 03 01:13:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27" returned: 0 in 0.990s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:13:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:13:59 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27 Jul 03 01:13:59 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:00 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27" returned: 1 in 0.918s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:14:00 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Downloaded image 53ee9a34-e59a-447a-8f99-0e740022d81d ((None, [{'url': 'file:///opt/stack/data/glance/images/53ee9a34-e59a-447a-8f99-0e740022d81d', 'metadata': {}}])) to volume 633c26e0-badc-4109-b017-b654fa8f1d27 successfully. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 01:14:00 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Temporary image 53ee9a34-e59a-447a-8f99-0e740022d81d for user c0ef64630a414bcda50a954f64285b68 is deleted. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 01:14:00 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Marking volume 633c26e0-badc-4109-b017-b654fa8f1d27 as bootable. {{(pid=86772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 01:14:00 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Copying metadata from image 53ee9a34-e59a-447a-8f99-0e740022d81d to 633c26e0-badc-4109-b017-b654fa8f1d27. {{(pid=86772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 01:14:00 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Creating volume glance metadata for volume 633c26e0-badc-4109-b017-b654fa8f1d27 backed by image 53ee9a34-e59a-447a-8f99-0e740022d81d with: {'image_id': '53ee9a34-e59a-447a-8f99-0e740022d81d', 'image_name': 'tempest-scenario-img--1286211365', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 01:14:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c62392e-e324-4d39-b9d3-d3a95f66a4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-633c26e0-badc-4109-b017-b654fa8f1d27', 'volume_size': 1, 'image_id': '53ee9a34-e59a-447a-8f99-0e740022d81d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/53ee9a34-e59a-447a-8f99-0e740022d81d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1286211365', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f10a8943a2dd4a509402e63683b2beac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '53ee9a34-e59a-447a-8f99-0e740022d81d', 'created_at': datetime.datetime(2026, 7, 2, 23, 13, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 13, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/53ee9a34-e59a-447a-8f99-0e740022d81d/file', 'properties': {}}, 'image_service': }' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a221533-edfa-434a-9adf-4be3bc55e9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:00 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Volume volume-633c26e0-badc-4109-b017-b654fa8f1d27 (633c26e0-badc-4109-b017-b654fa8f1d27): created successfully Jul 03 01:14:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a221533-edfa-434a-9adf-4be3bc55e9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Flow 'volume_create_manager' (372e75be-b6ae-4740-976f-c8685687e40f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:14:00 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-08e38c94-784e-4c71-9558-9262e1ed667c tempest-TestInstancesWithCinderVolumes-1251159148 None] Created volume successfully. Jul 03 01:14:01 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:14:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Flow 'volume_create_manager' (70599e09-67a0-4bf6-b6a5-4dfc701b6fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:14:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881f14f5-1315-4663-afd9-dde735305212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881f14f5-1315-4663-afd9-dde735305212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2048808797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27141210-22c2-49ea-8f04-ea4e3cde8140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48155c8c3d49496497ad64be3c86ea87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:01Z,use_quota=True,user_id='ad1a11527b1d4dce86449d62ffd77b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329ae739-21af-4d9a-9583-0fd9d649f847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329ae739-21af-4d9a-9583-0fd9d649f847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5edd32-ab94-457d-bff8-0d40f8c0eca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5edd32-ab94-457d-bff8-0d40f8c0eca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27141210-22c2-49ea-8f04-ea4e3cde8140', 'volume_name': 'volume-27141210-22c2-49ea-8f04-ea4e3cde8140', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42fff9e9-1c0c-4fc1-bb85-1b2ab5a4c92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42fff9e9-1c0c-4fc1-bb85-1b2ab5a4c92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c451c56d-af2c-49f9-9d04-7d9f1feb4986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:01 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Volume 27141210-22c2-49ea-8f04-ea4e3cde8140: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27141210-22c2-49ea-8f04-ea4e3cde8140', 'volume_size': 1} Jul 03 01:14:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2048808797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27141210-22c2-49ea-8f04-ea4e3cde8140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48155c8c3d49496497ad64be3c86ea87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:01Z,use_quota=True,user_id='ad1a11527b1d4dce86449d62ffd77b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:14:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Creating volume 27141210-22c2-49ea-8f04-ea4e3cde8140 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:14:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:14:01 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:14:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:01 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140 1073741824 Jul 03 01:14:01 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-1e9c4948-304c-45d2-bc67-1e1cc7398830 req-7239b9c5-7e82-43b2-9d6e-e7812b38375d tempest-AttachVolumeTestJSON-1781287949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:02 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140 1073741824" returned: 0 in 1.068s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:02 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140 Jul 03 01:14:02 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:03 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140" returned: 0 in 0.761s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] <== create_volume: return (1900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:14:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-1e9c4948-304c-45d2-bc67-1e1cc7398830 req-7239b9c5-7e82-43b2-9d6e-e7812b38375d tempest-AttachVolumeTestJSON-1781287949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.594s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c451c56d-af2c-49f9-9d04-7d9f1feb4986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27141210-22c2-49ea-8f04-ea4e3cde8140', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae558fc5-ffe3-4d34-b84e-d0ea937c4a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:03 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1f6848-8e76-40ef-a298-3da38d4a47f2]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-1e9c4948-304c-45d2-bc67-1e1cc7398830 req-7239b9c5-7e82-43b2-9d6e-e7812b38375d tempest-AttachVolumeTestJSON-1781287949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:03 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Volume volume-27141210-22c2-49ea-8f04-ea4e3cde8140 (27141210-22c2-49ea-8f04-ea4e3cde8140): created successfully Jul 03 01:14:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae558fc5-ffe3-4d34-b84e-d0ea937c4a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Flow 'volume_create_manager' (70599e09-67a0-4bf6-b6a5-4dfc701b6fc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:14:03 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f1245922-5c93-494a-b243-cd2cd7e701c7 tempest-VolumesDeleteCascade-2130147687 None] Created volume successfully. Jul 03 01:14:03 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91 Jul 03 01:14:03 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:04 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-1e9c4948-304c-45d2-bc67-1e1cc7398830 req-7239b9c5-7e82-43b2-9d6e-e7812b38375d tempest-AttachVolumeTestJSON-1781287949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91" returned: 0 in 0.843s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-1e9c4948-304c-45d2-bc67-1e1cc7398830 req-7239b9c5-7e82-43b2-9d6e-e7812b38375d tempest-AttachVolumeTestJSON-1781287949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.877s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-1e9c4948-304c-45d2-bc67-1e1cc7398830 req-7239b9c5-7e82-43b2-9d6e-e7812b38375d tempest-AttachVolumeTestJSON-1781287949 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171', 'name': 'volume-6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20363bc9-9b14-41b3-bbaa-ef08b8385af3', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:14:04 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-1e9c4948-304c-45d2-bc67-1e1cc7398830 req-7239b9c5-7e82-43b2-9d6e-e7812b38375d tempest-AttachVolumeTestJSON-1781287949 None] attachment_update completed successfully. Jul 03 01:14:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b2f87115-8770-4f97-9a90-f13990e5cb51 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b2f87115-8770-4f97-9a90-f13990e5cb51 tempest-VolumesDeleteCascade-2130147687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-b2f87115-8770-4f97-9a90-f13990e5cb51 tempest-VolumesDeleteCascade-2130147687 None] Creating offline snapshot baa4cb15-aa8a-4401-83fb-7e1af5a2b184 of volume 27141210-22c2-49ea-8f04-ea4e3cde8140 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:14:04 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fcbebc-bbce-4f53-a86f-3c4cb2a7975f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b2f87115-8770-4f97-9a90-f13990e5cb51 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:04 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140 Jul 03 01:14:04 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:05 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b2f87115-8770-4f97-9a90-f13990e5cb51 tempest-VolumesDeleteCascade-2130147687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140" returned: 0 in 0.822s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b2f87115-8770-4f97-9a90-f13990e5cb51 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:05 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184 1G Jul 03 01:14:05 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:06 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b2f87115-8770-4f97-9a90-f13990e5cb51 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184 1G" returned: 0 in 0.825s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b2f87115-8770-4f97-9a90-f13990e5cb51 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27141210-22c2-49ea-8f04-ea4e3cde8140 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:06 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27141210-22c2-49ea-8f04-ea4e3cde8140 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184 Jul 03 01:14:06 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:06 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b2f87115-8770-4f97-9a90-f13990e5cb51 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27141210-22c2-49ea-8f04-ea4e3cde8140 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184" returned: 0 in 0.735s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:06 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-b2f87115-8770-4f97-9a90-f13990e5cb51 tempest-VolumesDeleteCascade-2130147687 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184 is being set with open permissions: ugo+rw Jul 03 01:14:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b2f87115-8770-4f97-9a90-f13990e5cb51 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:06 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184 Jul 03 01:14:06 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:07 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b2f87115-8770-4f97-9a90-f13990e5cb51 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184" returned: 0 in 0.670s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b2f87115-8770-4f97-9a90-f13990e5cb51 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:07 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.info Jul 03 01:14:07 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:08 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b2f87115-8770-4f97-9a90-f13990e5cb51 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.info" returned: 0 in 0.804s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:08 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-b2f87115-8770-4f97-9a90-f13990e5cb51 tempest-VolumesDeleteCascade-2130147687 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.info is being set with open permissions: ugo+rw Jul 03 01:14:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b2f87115-8770-4f97-9a90-f13990e5cb51 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:08 devstack sudo[98707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.info Jul 03 01:14:08 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:09 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b2f87115-8770-4f97-9a90-f13990e5cb51 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.info" returned: 0 in 0.887s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b2f87115-8770-4f97-9a90-f13990e5cb51 tempest-VolumesDeleteCascade-2130147687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.871s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:09 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b2f87115-8770-4f97-9a90-f13990e5cb51 tempest-VolumesDeleteCascade-2130147687 None] Create snapshot completed successfully Jul 03 01:14:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-67ef50fe-fa88-47fe-8464-babd08882957 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-67ef50fe-fa88-47fe-8464-babd08882957 tempest-VolumesDeleteCascade-2130147687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-67ef50fe-fa88-47fe-8464-babd08882957 tempest-VolumesDeleteCascade-2130147687 None] Creating offline snapshot 299441fb-a8a9-40cf-a329-9454a2ed6701 of volume 27141210-22c2-49ea-8f04-ea4e3cde8140 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:14:10 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68f9f27-baf2-449f-833b-106200870f0c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-67ef50fe-fa88-47fe-8464-babd08882957 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:10 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184 Jul 03 01:14:10 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:11 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-67ef50fe-fa88-47fe-8464-babd08882957 tempest-VolumesDeleteCascade-2130147687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184" returned: 0 in 1.042s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-67ef50fe-fa88-47fe-8464-babd08882957 tempest-VolumesDeleteCascade-2130147687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27141210-22c2-49ea-8f04-ea4e3cde8140(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:14:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-67ef50fe-fa88-47fe-8464-babd08882957 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.299441fb-a8a9-40cf-a329-9454a2ed6701 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:11 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.299441fb-a8a9-40cf-a329-9454a2ed6701 1G Jul 03 01:14:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-553cf258-d0ce-483a-94ad-98e1747ff38e req-79accd38-a9a6-44e5-a278-f4f1ed19c423 tempest-TestInstancesWithCinderVolumes-1251159148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:11 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:11 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-2b359e85-1bf6-487c-9975-f413fa5b7172 req-29a9e50f-7657-46ad-8498-e18aab68093a tempest-AttachVolumeTestJSON-1781287949 None] Terminate volume connection completed successfully. Jul 03 01:14:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-2b359e85-1bf6-487c-9975-f413fa5b7172 req-29a9e50f-7657-46ad-8498-e18aab68093a tempest-AttachVolumeTestJSON-1781287949 None] Deleting attachment cd1690cf-d3ab-4aec-b60b-3581cd45f148. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:14:12 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-67ef50fe-fa88-47fe-8464-babd08882957 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.299441fb-a8a9-40cf-a329-9454a2ed6701 1G" returned: 0 in 1.078s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-67ef50fe-fa88-47fe-8464-babd08882957 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.299441fb-a8a9-40cf-a329-9454a2ed6701 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:12 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.299441fb-a8a9-40cf-a329-9454a2ed6701 Jul 03 01:14:12 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:14:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:12 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:14:12 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:13 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-67ef50fe-fa88-47fe-8464-babd08882957 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.299441fb-a8a9-40cf-a329-9454a2ed6701" returned: 0 in 0.969s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:13 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-67ef50fe-fa88-47fe-8464-babd08882957 tempest-VolumesDeleteCascade-2130147687 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.299441fb-a8a9-40cf-a329-9454a2ed6701 is being set with open permissions: ugo+rw Jul 03 01:14:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-67ef50fe-fa88-47fe-8464-babd08882957 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.299441fb-a8a9-40cf-a329-9454a2ed6701 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:13 devstack sudo[98824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.299441fb-a8a9-40cf-a329-9454a2ed6701 Jul 03 01:14:13 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:13 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.792s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:14:13 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:14:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:14:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:14:14 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:14 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=82,cinder:INSERT=23,cinder:UPDATE=86,cinder:DELETE=10 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:14:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-67ef50fe-fa88-47fe-8464-babd08882957 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.299441fb-a8a9-40cf-a329-9454a2ed6701" returned: 0 in 0.773s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:14 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=77,cinder:INSERT=25,cinder:UPDATE=94,cinder:DELETE=7 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:14:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-67ef50fe-fa88-47fe-8464-babd08882957 tempest-VolumesDeleteCascade-2130147687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.068s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:14 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-6e707e1c-80fa-4578-a5e0-dae88abbb738 req-bd69da75-44a6-41af-9f1d-65f45ea03556 tempest-AttachVolumeTestJSON-1781287949 None] Terminate volume connection completed successfully. Jul 03 01:14:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-6e707e1c-80fa-4578-a5e0-dae88abbb738 req-bd69da75-44a6-41af-9f1d-65f45ea03556 tempest-AttachVolumeTestJSON-1781287949 None] Deleting attachment 20363bc9-9b14-41b3-bbaa-ef08b8385af3. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:14:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-553cf258-d0ce-483a-94ad-98e1747ff38e req-79accd38-a9a6-44e5-a278-f4f1ed19c423 tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.841s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:14 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-67ef50fe-fa88-47fe-8464-babd08882957 tempest-VolumesDeleteCascade-2130147687 None] Create snapshot completed successfully Jul 03 01:14:14 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d140fbe2-4842-4d54-a6a1-5948fd71c24f]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-553cf258-d0ce-483a-94ad-98e1747ff38e req-79accd38-a9a6-44e5-a278-f4f1ed19c423 tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:14 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27 Jul 03 01:14:14 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "cinder-27141210-22c2-49ea-8f04-ea4e3cde8140-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-27141210-22c2-49ea-8f04-ea4e3cde8140-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Performing cascade delete. {{(pid=86772) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 03 01:14:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "cinder-299441fb-a8a9-40cf-a329-9454a2ed6701-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-299441fb-a8a9-40cf-a329-9454a2ed6701-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "cinder-quobyte-27141210-22c2-49ea-8f04-ea4e3cde8140" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-quobyte-27141210-22c2-49ea-8f04-ea4e3cde8140" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "cinder-quobyte-299441fb-a8a9-40cf-a329-9454a2ed6701" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-quobyte-299441fb-a8a9-40cf-a329-9454a2ed6701" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Deleting offline snapshot 299441fb-a8a9-40cf-a329-9454a2ed6701 of volume 27141210-22c2-49ea-8f04-ea4e3cde8140 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:14:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] snapshot_file for this snap is: volume-27141210-22c2-49ea-8f04-ea4e3cde8140.299441fb-a8a9-40cf-a329-9454a2ed6701 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:14:15 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d53c16-a7d8-4edd-9116-123542968603]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.299441fb-a8a9-40cf-a329-9454a2ed6701 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:15 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-553cf258-d0ce-483a-94ad-98e1747ff38e req-79accd38-a9a6-44e5-a278-f4f1ed19c423 tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27" returned: 0 in 1.413s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-553cf258-d0ce-483a-94ad-98e1747ff38e req-79accd38-a9a6-44e5-a278-f4f1ed19c423 tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:15 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.299441fb-a8a9-40cf-a329-9454a2ed6701 Jul 03 01:14:15 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:15 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27 Jul 03 01:14:15 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:16 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-553cf258-d0ce-483a-94ad-98e1747ff38e req-79accd38-a9a6-44e5-a278-f4f1ed19c423 tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27" returned: 1 in 1.179s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-553cf258-d0ce-483a-94ad-98e1747ff38e req-79accd38-a9a6-44e5-a278-f4f1ed19c423 tempest-TestInstancesWithCinderVolumes-1251159148 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:14:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-553cf258-d0ce-483a-94ad-98e1747ff38e req-79accd38-a9a6-44e5-a278-f4f1ed19c423 tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.655s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-553cf258-d0ce-483a-94ad-98e1747ff38e req-79accd38-a9a6-44e5-a278-f4f1ed19c423 tempest-TestInstancesWithCinderVolumes-1251159148 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171', 'name': 'volume-633c26e0-badc-4109-b017-b654fa8f1d27', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77551ce3-390c-44c9-9066-b0ef142acb8c', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:14:16 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-553cf258-d0ce-483a-94ad-98e1747ff38e req-79accd38-a9a6-44e5-a278-f4f1ed19c423 tempest-TestInstancesWithCinderVolumes-1251159148 None] attachment_update completed successfully. Jul 03 01:14:17 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.299441fb-a8a9-40cf-a329-9454a2ed6701" returned: 0 in 1.584s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27141210-22c2-49ea-8f04-ea4e3cde8140(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:14:17 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9703878b-49a8-40ce-a6bc-24a6c2201ec1]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:17 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184 Jul 03 01:14:17 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:18 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184" returned: 0 in 1.552s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27141210-22c2-49ea-8f04-ea4e3cde8140(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:14:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.299441fb-a8a9-40cf-a329-9454a2ed6701 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:18 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.299441fb-a8a9-40cf-a329-9454a2ed6701 Jul 03 01:14:18 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:19 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.299441fb-a8a9-40cf-a329-9454a2ed6701" returned: 0 in 1.379s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.299441fb-a8a9-40cf-a329-9454a2ed6701 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:20 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.299441fb-a8a9-40cf-a329-9454a2ed6701 Jul 03 01:14:20 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:21 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.299441fb-a8a9-40cf-a329-9454a2ed6701" returned: 0 in 1.032s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-quobyte-299441fb-a8a9-40cf-a329-9454a2ed6701" released by "_delete_snapshot" :: held 5.724s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-quobyte-27141210-22c2-49ea-8f04-ea4e3cde8140" released by "delete_snapshot" :: held 5.786s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:21 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Created reservations ['d39c8711-3803-4e71-9e56-ecd03b122460', 'aa3c66de-e1a3-4df5-b40e-ce56a807a409', 'c081ceb2-9b88-4c98-812f-df380505604d', '1a6b4844-d822-4cd0-8676-452d3e4363a3'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:14:21 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Delete snapshot completed successfully. Jul 03 01:14:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-299441fb-a8a9-40cf-a329-9454a2ed6701-delete_snapshot" released by "delete_snapshot" :: held 6.029s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "cinder-baa4cb15-aa8a-4401-83fb-7e1af5a2b184-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-baa4cb15-aa8a-4401-83fb-7e1af5a2b184-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "cinder-quobyte-27141210-22c2-49ea-8f04-ea4e3cde8140" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-quobyte-27141210-22c2-49ea-8f04-ea4e3cde8140" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "cinder-quobyte-baa4cb15-aa8a-4401-83fb-7e1af5a2b184" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-quobyte-baa4cb15-aa8a-4401-83fb-7e1af5a2b184" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Deleting offline snapshot baa4cb15-aa8a-4401-83fb-7e1af5a2b184 of volume 27141210-22c2-49ea-8f04-ea4e3cde8140 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:14:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] snapshot_file for this snap is: volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:14:21 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[77515c86-62d1-4139-ac81-00faaa35a686]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:21 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184 Jul 03 01:14:21 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:22 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184" returned: 0 in 1.056s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27141210-22c2-49ea-8f04-ea4e3cde8140(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:14:22 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[238452cc-2a3d-4614-bb9b-222bb2eba833]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:22 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140 Jul 03 01:14:22 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:24 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140" returned: 0 in 1.796s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:24 devstack sudo[99424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184 Jul 03 01:14:24 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:25 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184" returned: 0 in 1.286s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:25 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184 Jul 03 01:14:25 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:26 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140.baa4cb15-aa8a-4401-83fb-7e1af5a2b184" returned: 0 in 1.369s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-quobyte-baa4cb15-aa8a-4401-83fb-7e1af5a2b184" released by "_delete_snapshot" :: held 5.723s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-quobyte-27141210-22c2-49ea-8f04-ea4e3cde8140" released by "delete_snapshot" :: held 5.762s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a8ea6e41-a1c2-4c0d-b96a-042b7442a83a tempest-AttachVolumeTestJSON-1781287949 None] Acquiring lock "cinder-6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a8ea6e41-a1c2-4c0d-b96a-042b7442a83a tempest-AttachVolumeTestJSON-1781287949 None] Lock "cinder-6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:27 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Created reservations ['fa15be52-70e6-4592-b9ec-8d91c0139b43', 'fa11fd34-e03a-48ff-bc73-35bc8b566101', '67c3d347-57a0-4ae6-8c62-dc00cabaff0e', '3d7fe670-1937-4c2d-8816-3dbabc73898d'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:14:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a8ea6e41-a1c2-4c0d-b96a-042b7442a83a tempest-AttachVolumeTestJSON-1781287949 None] Acquiring lock "cinder-quobyte-6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a8ea6e41-a1c2-4c0d-b96a-042b7442a83a tempest-AttachVolumeTestJSON-1781287949 None] Lock "cinder-quobyte-6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91" acquired by "delete_volume" :: waited 0.058s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:27 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb44c70b-e6a7-47a3-9539-7ef2e6666efe]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a8ea6e41-a1c2-4c0d-b96a-042b7442a83a tempest-AttachVolumeTestJSON-1781287949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:27 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Delete snapshot completed successfully. Jul 03 01:14:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-baa4cb15-aa8a-4401-83fb-7e1af5a2b184-delete_snapshot" released by "delete_snapshot" :: held 6.255s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Snapshots deleted, issuing volume delete {{(pid=86772) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 03 01:14:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "cinder-quobyte-27141210-22c2-49ea-8f04-ea4e3cde8140" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-quobyte-27141210-22c2-49ea-8f04-ea4e3cde8140" acquired by "delete_volume" :: waited 0.037s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:27 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c79cdb5-257a-4887-abe6-2143fb5c8c3a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:27 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91 Jul 03 01:14:27 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:27 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140 Jul 03 01:14:27 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:28 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140" returned: 0 in 1.370s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:28 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140 Jul 03 01:14:28 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:29 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a8ea6e41-a1c2-4c0d-b96a-042b7442a83a tempest-AttachVolumeTestJSON-1781287949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91" returned: 0 in 1.779s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a8ea6e41-a1c2-4c0d-b96a-042b7442a83a tempest-AttachVolumeTestJSON-1781287949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:29 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91 Jul 03 01:14:29 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:30 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a8ea6e41-a1c2-4c0d-b96a-042b7442a83a tempest-AttachVolumeTestJSON-1781287949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91" returned: 0 in 1.026s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a8ea6e41-a1c2-4c0d-b96a-042b7442a83a tempest-AttachVolumeTestJSON-1781287949 None] Lock "cinder-quobyte-6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91" released by "delete_volume" :: held 2.903s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:30 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-a8ea6e41-a1c2-4c0d-b96a-042b7442a83a tempest-AttachVolumeTestJSON-1781287949 None] Created reservations ['94e74b86-07f1-4c45-89a8-2ea504368f5a', 'e6deaec5-e794-41ac-bd7e-94e013c88d0b', 'c5359694-34e5-4c9f-a98b-763e7b81fb98', '07094346-6636-410f-bc6d-e999773e56bb'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:14:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a8ea6e41-a1c2-4c0d-b96a-042b7442a83a tempest-AttachVolumeTestJSON-1781287949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a8ea6e41-a1c2-4c0d-b96a-042b7442a83a tempest-AttachVolumeTestJSON-1781287949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a8ea6e41-a1c2-4c0d-b96a-042b7442a83a tempest-AttachVolumeTestJSON-1781287949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a8ea6e41-a1c2-4c0d-b96a-042b7442a83a tempest-AttachVolumeTestJSON-1781287949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a8ea6e41-a1c2-4c0d-b96a-042b7442a83a tempest-AttachVolumeTestJSON-1781287949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a8ea6e41-a1c2-4c0d-b96a-042b7442a83a tempest-AttachVolumeTestJSON-1781287949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:30 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:14:30 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:30 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-27141210-22c2-49ea-8f04-ea4e3cde8140" returned: 0 in 1.521s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-quobyte-27141210-22c2-49ea-8f04-ea4e3cde8140" released by "delete_volume" :: held 3.011s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:30 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Created reservations ['47c55b54-3ceb-4bf8-b4c6-b871d2986e53', '094b3164-9cb2-4e05-91b4-50e7b05d703a', '2a30bbb5-c4fc-4175-a635-843aac273981', 'f55a5f60-1a6d-4ef4-bf29-5fd85f5efe89'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:14:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d4ce6acb-ed6e-4477-a4c4-13d774f76051 tempest-AttachVolumeTestJSON-1781287949 None] Acquiring lock "cinder-90d7d122-dd56-4c41-85cd-5ae73f3b1e54-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d4ce6acb-ed6e-4477-a4c4-13d774f76051 tempest-AttachVolumeTestJSON-1781287949 None] Lock "cinder-90d7d122-dd56-4c41-85cd-5ae73f3b1e54-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d4ce6acb-ed6e-4477-a4c4-13d774f76051 tempest-AttachVolumeTestJSON-1781287949 None] Acquiring lock "cinder-quobyte-90d7d122-dd56-4c41-85cd-5ae73f3b1e54" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:30 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:14:30 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d4ce6acb-ed6e-4477-a4c4-13d774f76051 tempest-AttachVolumeTestJSON-1781287949 None] Lock "cinder-quobyte-90d7d122-dd56-4c41-85cd-5ae73f3b1e54" acquired by "delete_volume" :: waited 0.055s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:30 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06eb08e-423d-47d7-a027-509ae7b21e42]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d4ce6acb-ed6e-4477-a4c4-13d774f76051 tempest-AttachVolumeTestJSON-1781287949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-90d7d122-dd56-4c41-85cd-5ae73f3b1e54 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:31 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-90d7d122-dd56-4c41-85cd-5ae73f3b1e54 Jul 03 01:14:31 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:31 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a8ea6e41-a1c2-4c0d-b96a-042b7442a83a tempest-AttachVolumeTestJSON-1781287949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.522s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:31 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-a8ea6e41-a1c2-4c0d-b96a-042b7442a83a tempest-AttachVolumeTestJSON-1781287949 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:14:31 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a8ea6e41-a1c2-4c0d-b96a-042b7442a83a tempest-AttachVolumeTestJSON-1781287949 None] Deleted volume successfully. Jul 03 01:14:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a8ea6e41-a1c2-4c0d-b96a-042b7442a83a tempest-AttachVolumeTestJSON-1781287949 None] Lock "cinder-6c8b01ec-a23e-4fb3-9ce3-5dd311a9ae91-delete_volume" released by "delete_volume" :: held 4.883s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:32 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.629s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:32 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:14:32 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Deleted volume successfully. Jul 03 01:14:32 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d4ce6acb-ed6e-4477-a4c4-13d774f76051 tempest-AttachVolumeTestJSON-1781287949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-90d7d122-dd56-4c41-85cd-5ae73f3b1e54" returned: 0 in 1.596s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d4ce6acb-ed6e-4477-a4c4-13d774f76051 tempest-AttachVolumeTestJSON-1781287949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-90d7d122-dd56-4c41-85cd-5ae73f3b1e54 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-309fe459-e957-4a0f-963c-549e8d783913 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-27141210-22c2-49ea-8f04-ea4e3cde8140-delete_volume" released by "delete_volume" :: held 17.614s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:32 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-90d7d122-dd56-4c41-85cd-5ae73f3b1e54 Jul 03 01:14:32 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:32 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:14:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Flow 'volume_create_manager' (fdfed4d3-181f-44c0-8cab-ab550d7bb2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:14:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b050820a-fd7a-48c9-a5b7-50471ad130b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b050820a-fd7a-48c9-a5b7-50471ad130b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2070098998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c990c0-921c-4aa0-b1e8-1ba94441c0b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48155c8c3d49496497ad64be3c86ea87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:33Z,use_quota=True,user_id='ad1a11527b1d4dce86449d62ffd77b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cedc2c32-b5d0-48cf-9f20-5ffea566da8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cedc2c32-b5d0-48cf-9f20-5ffea566da8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac9301b6-8c45-4863-8299-810d4705ef81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac9301b6-8c45-4863-8299-810d4705ef81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46c990c0-921c-4aa0-b1e8-1ba94441c0b4', 'volume_name': 'volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d741014-0d1b-4b15-b8f9-811f26794964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d741014-0d1b-4b15-b8f9-811f26794964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da791725-28a6-44d9-8c60-87f2c0648b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:33 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Volume 46c990c0-921c-4aa0-b1e8-1ba94441c0b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4', 'volume_size': 1} Jul 03 01:14:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2070098998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c990c0-921c-4aa0-b1e8-1ba94441c0b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48155c8c3d49496497ad64be3c86ea87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:33Z,use_quota=True,user_id='ad1a11527b1d4dce86449d62ffd77b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:14:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Creating volume 46c990c0-921c-4aa0-b1e8-1ba94441c0b4 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:14:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:14:33 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:14:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:33 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4 1073741824 Jul 03 01:14:33 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:33 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d4ce6acb-ed6e-4477-a4c4-13d774f76051 tempest-AttachVolumeTestJSON-1781287949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-90d7d122-dd56-4c41-85cd-5ae73f3b1e54" returned: 0 in 1.193s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d4ce6acb-ed6e-4477-a4c4-13d774f76051 tempest-AttachVolumeTestJSON-1781287949 None] Lock "cinder-quobyte-90d7d122-dd56-4c41-85cd-5ae73f3b1e54" released by "delete_volume" :: held 2.880s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:33 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-d4ce6acb-ed6e-4477-a4c4-13d774f76051 tempest-AttachVolumeTestJSON-1781287949 None] Created reservations ['26c3bbc1-3583-4787-84ae-9bbfb29892de', '6499eaf2-690e-4432-b205-1189a59efe6a', '81a10f76-6874-4cad-b6e0-b340bf35c93a', '5a12c8f3-747a-445d-be97-f51c7a66e27d'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:14:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d4ce6acb-ed6e-4477-a4c4-13d774f76051 tempest-AttachVolumeTestJSON-1781287949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d4ce6acb-ed6e-4477-a4c4-13d774f76051 tempest-AttachVolumeTestJSON-1781287949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d4ce6acb-ed6e-4477-a4c4-13d774f76051 tempest-AttachVolumeTestJSON-1781287949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d4ce6acb-ed6e-4477-a4c4-13d774f76051 tempest-AttachVolumeTestJSON-1781287949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d4ce6acb-ed6e-4477-a4c4-13d774f76051 tempest-AttachVolumeTestJSON-1781287949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d4ce6acb-ed6e-4477-a4c4-13d774f76051 tempest-AttachVolumeTestJSON-1781287949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:34 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:14:34 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:34 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4 1073741824" returned: 0 in 1.345s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:34 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4 Jul 03 01:14:34 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-37f5f798-c92b-49b5-a28e-7974acdd5fd3 tempest-AttachVolumeTestJSON-1781287949 None] Acquiring lock "cinder-8297fbaf-eab3-4eee-a385-7140a29552dc-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-37f5f798-c92b-49b5-a28e-7974acdd5fd3 tempest-AttachVolumeTestJSON-1781287949 None] Lock "cinder-8297fbaf-eab3-4eee-a385-7140a29552dc-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-37f5f798-c92b-49b5-a28e-7974acdd5fd3 tempest-AttachVolumeTestJSON-1781287949 None] Acquiring lock "cinder-quobyte-8297fbaf-eab3-4eee-a385-7140a29552dc" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-37f5f798-c92b-49b5-a28e-7974acdd5fd3 tempest-AttachVolumeTestJSON-1781287949 None] Lock "cinder-quobyte-8297fbaf-eab3-4eee-a385-7140a29552dc" acquired by "delete_volume" :: waited 0.043s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:34 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa250690-e80e-4076-9e54-76ffe18c28e0]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-37f5f798-c92b-49b5-a28e-7974acdd5fd3 tempest-AttachVolumeTestJSON-1781287949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8297fbaf-eab3-4eee-a385-7140a29552dc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:35 devstack sudo[99487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8297fbaf-eab3-4eee-a385-7140a29552dc Jul 03 01:14:35 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:35 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d4ce6acb-ed6e-4477-a4c4-13d774f76051 tempest-AttachVolumeTestJSON-1781287949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.190s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:35 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-d4ce6acb-ed6e-4477-a4c4-13d774f76051 tempest-AttachVolumeTestJSON-1781287949 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:14:35 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d4ce6acb-ed6e-4477-a4c4-13d774f76051 tempest-AttachVolumeTestJSON-1781287949 None] Deleted volume successfully. Jul 03 01:14:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d4ce6acb-ed6e-4477-a4c4-13d774f76051 tempest-AttachVolumeTestJSON-1781287949 None] Lock "cinder-90d7d122-dd56-4c41-85cd-5ae73f3b1e54-delete_volume" released by "delete_volume" :: held 4.457s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:35 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4" returned: 0 in 1.257s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] <== create_volume: return (2736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:14:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.740s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da791725-28a6-44d9-8c60-87f2c0648b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec860ecd-f1e1-4780-962a-fd611fa5c72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:35 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Volume volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4 (46c990c0-921c-4aa0-b1e8-1ba94441c0b4): created successfully Jul 03 01:14:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec860ecd-f1e1-4780-962a-fd611fa5c72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:35 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Flow 'volume_create_manager' (fdfed4d3-181f-44c0-8cab-ab550d7bb2c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:14:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-37f5f798-c92b-49b5-a28e-7974acdd5fd3 tempest-AttachVolumeTestJSON-1781287949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8297fbaf-eab3-4eee-a385-7140a29552dc" returned: 0 in 1.108s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-37f5f798-c92b-49b5-a28e-7974acdd5fd3 tempest-AttachVolumeTestJSON-1781287949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8297fbaf-eab3-4eee-a385-7140a29552dc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:36 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-45171a3a-26bc-4d8a-b76b-53b11c194802 tempest-VolumesDeleteCascade-2130147687 None] Created volume successfully. Jul 03 01:14:36 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8297fbaf-eab3-4eee-a385-7140a29552dc Jul 03 01:14:36 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:36 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-37f5f798-c92b-49b5-a28e-7974acdd5fd3 tempest-AttachVolumeTestJSON-1781287949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8297fbaf-eab3-4eee-a385-7140a29552dc" returned: 0 in 0.711s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-37f5f798-c92b-49b5-a28e-7974acdd5fd3 tempest-AttachVolumeTestJSON-1781287949 None] Lock "cinder-quobyte-8297fbaf-eab3-4eee-a385-7140a29552dc" released by "delete_volume" :: held 1.880s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:36 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-37f5f798-c92b-49b5-a28e-7974acdd5fd3 tempest-AttachVolumeTestJSON-1781287949 None] Created reservations ['c54fcf9f-3404-4a51-8be5-5cedc4cdc353', '2b6ba8ce-222a-453a-b85b-1170676df2b8', 'd3d3c444-f0c6-4da6-a02d-22f1bfe6f56b', '03fd3551-85c3-477b-8c6a-e1d90316a506'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:14:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-37f5f798-c92b-49b5-a28e-7974acdd5fd3 tempest-AttachVolumeTestJSON-1781287949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-37f5f798-c92b-49b5-a28e-7974acdd5fd3 tempest-AttachVolumeTestJSON-1781287949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-37f5f798-c92b-49b5-a28e-7974acdd5fd3 tempest-AttachVolumeTestJSON-1781287949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-37f5f798-c92b-49b5-a28e-7974acdd5fd3 tempest-AttachVolumeTestJSON-1781287949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-37f5f798-c92b-49b5-a28e-7974acdd5fd3 tempest-AttachVolumeTestJSON-1781287949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-37f5f798-c92b-49b5-a28e-7974acdd5fd3 tempest-AttachVolumeTestJSON-1781287949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:36 devstack sudo[99498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:14:36 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-782b3c62-8d67-4ce5-9b3f-3f49161e5773 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-782b3c62-8d67-4ce5-9b3f-3f49161e5773 tempest-VolumesDeleteCascade-2130147687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-782b3c62-8d67-4ce5-9b3f-3f49161e5773 tempest-VolumesDeleteCascade-2130147687 None] Creating offline snapshot aca6d5b2-2668-4e0c-9be1-68d523d706be of volume 46c990c0-921c-4aa0-b1e8-1ba94441c0b4 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:14:37 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83e1aa1-6039-458c-9975-5436fa6b7b8a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-782b3c62-8d67-4ce5-9b3f-3f49161e5773 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:38 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4 Jul 03 01:14:38 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:38 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-37f5f798-c92b-49b5-a28e-7974acdd5fd3 tempest-AttachVolumeTestJSON-1781287949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.301s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:38 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-37f5f798-c92b-49b5-a28e-7974acdd5fd3 tempest-AttachVolumeTestJSON-1781287949 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:14:38 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-37f5f798-c92b-49b5-a28e-7974acdd5fd3 tempest-AttachVolumeTestJSON-1781287949 None] Deleted volume successfully. Jul 03 01:14:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-37f5f798-c92b-49b5-a28e-7974acdd5fd3 tempest-AttachVolumeTestJSON-1781287949 None] Lock "cinder-8297fbaf-eab3-4eee-a385-7140a29552dc-delete_volume" released by "delete_volume" :: held 3.500s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:39 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-782b3c62-8d67-4ce5-9b3f-3f49161e5773 tempest-VolumesDeleteCascade-2130147687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4" returned: 0 in 1.414s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-782b3c62-8d67-4ce5-9b3f-3f49161e5773 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.aca6d5b2-2668-4e0c-9be1-68d523d706be 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:39 devstack sudo[99518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.aca6d5b2-2668-4e0c-9be1-68d523d706be 1G Jul 03 01:14:39 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:40 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-782b3c62-8d67-4ce5-9b3f-3f49161e5773 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.aca6d5b2-2668-4e0c-9be1-68d523d706be 1G" returned: 0 in 1.036s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-782b3c62-8d67-4ce5-9b3f-3f49161e5773 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.aca6d5b2-2668-4e0c-9be1-68d523d706be {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:40 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.aca6d5b2-2668-4e0c-9be1-68d523d706be Jul 03 01:14:40 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:41 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-782b3c62-8d67-4ce5-9b3f-3f49161e5773 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.aca6d5b2-2668-4e0c-9be1-68d523d706be" returned: 0 in 1.168s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:41 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-782b3c62-8d67-4ce5-9b3f-3f49161e5773 tempest-VolumesDeleteCascade-2130147687 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.aca6d5b2-2668-4e0c-9be1-68d523d706be is being set with open permissions: ugo+rw Jul 03 01:14:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-782b3c62-8d67-4ce5-9b3f-3f49161e5773 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.aca6d5b2-2668-4e0c-9be1-68d523d706be {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:41 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.aca6d5b2-2668-4e0c-9be1-68d523d706be Jul 03 01:14:41 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:42 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:14:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Flow 'volume_create_manager' (24bcafe7-3835-479c-aa11-b0e84e08ba47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:14:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b0b33ec-19bd-4a13-a601-7f6c541ffa6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b0b33ec-19bd-4a13-a601-7f6c541ffa6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-893880299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f7ccadd5164f2d89096c952f3ee473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:42Z,use_quota=True,user_id='8b8b9e8c292445a789497cccb705c4ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3cf9ff7-aa48-4e29-933b-6865d4d361b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3cf9ff7-aa48-4e29-933b-6865d4d361b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (387ed7ef-ac74-4c94-a33d-bf0931a2e82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (387ed7ef-ac74-4c94-a33d-bf0931a2e82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5', 'volume_name': 'volume-ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d273057e-6b43-4ec7-999a-40574af71dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d273057e-6b43-4ec7-999a-40574af71dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f583302-3133-41e7-8387-394ec52bda63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:42 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Volume ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5', 'volume_size': 1} Jul 03 01:14:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:42 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-782b3c62-8d67-4ce5-9b3f-3f49161e5773 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.aca6d5b2-2668-4e0c-9be1-68d523d706be" returned: 0 in 1.181s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-782b3c62-8d67-4ce5-9b3f-3f49161e5773 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:42 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.info Jul 03 01:14:42 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:43 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-782b3c62-8d67-4ce5-9b3f-3f49161e5773 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.info" returned: 0 in 0.942s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:43 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-782b3c62-8d67-4ce5-9b3f-3f49161e5773 tempest-VolumesDeleteCascade-2130147687 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.info is being set with open permissions: ugo+rw Jul 03 01:14:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-782b3c62-8d67-4ce5-9b3f-3f49161e5773 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:43 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.info Jul 03 01:14:43 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:44 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-782b3c62-8d67-4ce5-9b3f-3f49161e5773 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.info" returned: 0 in 0.813s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-782b3c62-8d67-4ce5-9b3f-3f49161e5773 tempest-VolumesDeleteCascade-2130147687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.734s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.962s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-893880299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f7ccadd5164f2d89096c952f3ee473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:42Z,use_quota=True,user_id='8b8b9e8c292445a789497cccb705c4ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:14:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Creating volume ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:14:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:14:44 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:14:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:44 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5 1073741824 Jul 03 01:14:44 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:44 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-782b3c62-8d67-4ce5-9b3f-3f49161e5773 tempest-VolumesDeleteCascade-2130147687 None] Create snapshot completed successfully Jul 03 01:14:45 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5 1073741824" returned: 0 in 0.948s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:45 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5 Jul 03 01:14:45 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:45 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:14:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Flow 'volume_create_manager' (2a113e1c-b6c8-4c24-91e3-108666eed031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:14:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2766bb4f-c2ad-49f9-8be8-e3ca429c75aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2766bb4f-c2ad-49f9-8be8-e3ca429c75aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1338747568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c6bcdc-c5c7-4d27-96d1-f7421f1e087e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48155c8c3d49496497ad64be3c86ea87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aca6d5b2-2668-4e0c-9be1-68d523d706be,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:46Z,use_quota=True,user_id='ad1a11527b1d4dce86449d62ffd77b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa9c8c4a-60ad-4e35-ab55-8134ba320f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa9c8c4a-60ad-4e35-ab55-8134ba320f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2f7c38-00db-4e89-b80d-e01a5a4c49c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2f7c38-00db-4e89-b80d-e01a5a4c49c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '99c6bcdc-c5c7-4d27-96d1-f7421f1e087e', 'volume_name': 'volume-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e', 'volume_size': 1, 'snapshot_id': 'aca6d5b2-2668-4e0c-9be1-68d523d706be'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a16785d-a86d-455c-9619-1c086eb947eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a16785d-a86d-455c-9619-1c086eb947eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:45 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f63f16d-37e2-4beb-91a5-6afcf7cf125f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:45 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Volume 99c6bcdc-c5c7-4d27-96d1-f7421f1e087e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e', 'volume_size': 1, 'snapshot_id': 'aca6d5b2-2668-4e0c-9be1-68d523d706be'} Jul 03 01:14:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:46 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5" returned: 0 in 0.754s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.405s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "cinder-quobyte-aca6d5b2-2668-4e0c-9be1-68d523d706be-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e" by "_create_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f583302-3133-41e7-8387-394ec52bda63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4584001-eedd-45dd-9de8-ba6ca8fed463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-quobyte-aca6d5b2-2668-4e0c-9be1-68d523d706be-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Creating volume 99c6bcdc-c5c7-4d27-96d1-f7421f1e087e from snapshot aca6d5b2-2668-4e0c-9be1-68d523d706be {{(pid=86772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "cinder-quobyte-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e" by "_copy_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:46 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Volume volume-ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5 (ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5): created successfully Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4584001-eedd-45dd-9de8-ba6ca8fed463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Flow 'volume_create_manager' (24bcafe7-3835-479c-aa11-b0e84e08ba47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-quobyte-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] snapshot: aca6d5b2-2668-4e0c-9be1-68d523d706be, volume: 99c6bcdc-c5c7-4d27-96d1-f7421f1e087e, {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:46 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5c742b60-bc0d-4eb0-8894-a4ebecf22afe tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Created volume successfully. Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e67a82-f270-4abb-a5e3-818eaec3ac5c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.aca6d5b2-2668-4e0c-9be1-68d523d706be {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:46 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.aca6d5b2-2668-4e0c-9be1-68d523d706be Jul 03 01:14:46 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Flow 'volume_create_manager' (6c826474-d4c2-42f0-bc58-cecaac97e3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5751a754-9270-469d-9f5b-63d9e05bbd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5751a754-9270-469d-9f5b-63d9e05bbd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-311919348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fab90f28-2841-4f9b-afeb-bf63313aecd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3e8108b60d4d699c7b1b1c024d2371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:47Z,use_quota=True,user_id='15b20a72d0894bc0bcc2d27549c243d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (568aed3c-52ab-4431-8432-73219f6d9a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (568aed3c-52ab-4431-8432-73219f6d9a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a32569c8-9656-43e3-a466-fb97c332adbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a32569c8-9656-43e3-a466-fb97c332adbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fab90f28-2841-4f9b-afeb-bf63313aecd5', 'volume_name': 'volume-fab90f28-2841-4f9b-afeb-bf63313aecd5', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72562dc-2fbb-44b8-971f-c256a55ca86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72562dc-2fbb-44b8-971f-c256a55ca86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d533038d-a374-430f-92d8-4e14d79aa50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:46 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Volume fab90f28-2841-4f9b-afeb-bf63313aecd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fab90f28-2841-4f9b-afeb-bf63313aecd5', 'volume_size': 1} Jul 03 01:14:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:47 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.aca6d5b2-2668-4e0c-9be1-68d523d706be" returned: 0 in 0.804s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:14:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4 {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 01:14:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Creating direct copy from snapshot {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 01:14:47 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9f162e-5b12-475c-9242-64a1380c41a0]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:47 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4 Jul 03 01:14:47 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:47 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4" returned: 0 in 0.767s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:47 devstack cinder-volume[86772]: DEBUG cinder.utils [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Path /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e not found in is_blk_device check {{(pid=86772) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 01:14:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:47 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e Jul 03 01:14:47 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-e36ec9ad-1c32-465e-83a5-9ad9e9bd9614 req-79b3f2c4-5fe6-467d-b126-4c4b1b5d5f86 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e" returned: 0 in 6.619s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:54 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde344b0-d823-4e0a-bbdd-07500c2293cc]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:54 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4 Jul 03 01:14:54 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:55 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4" returned: 0 in 0.991s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:55 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Image conversion details: src /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4, size 1024.00 MB, duration 6.62 sec, destination /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:14:55 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Converted 1024.00 MB image at 154.62 MB/s Jul 03 01:14:55 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e is being set with open permissions: ugo+rw Jul 03 01:14:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:55 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e Jul 03 01:14:55 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:56 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e" returned: 0 in 0.654s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-quobyte-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e" released by "_copy_volume_from_snapshot" :: held 9.970s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-quobyte-aca6d5b2-2668-4e0c-9be1-68d523d706be-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e" released by "_create_volume_from_snapshot" :: held 10.014s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:14:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.053s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.365s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-311919348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fab90f28-2841-4f9b-afeb-bf63313aecd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3e8108b60d4d699c7b1b1c024d2371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:14:47Z,use_quota=True,user_id='15b20a72d0894bc0bcc2d27549c243d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:14:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Creating volume fab90f28-2841-4f9b-afeb-bf63313aecd5 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:14:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:14:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:14:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:14:56 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:14:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:56 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5 1073741824 Jul 03 01:14:56 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f63f16d-37e2-4beb-91a5-6afcf7cf125f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e', 'volume_size': 1, 'snapshot_id': 'aca6d5b2-2668-4e0c-9be1-68d523d706be'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d8324c-a50a-46c9-8916-901819a084ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:56 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Volume volume-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e (99c6bcdc-c5c7-4d27-96d1-f7421f1e087e): created successfully Jul 03 01:14:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d8324c-a50a-46c9-8916-901819a084ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Flow 'volume_create_manager' (2a113e1c-b6c8-4c24-91e3-108666eed031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:14:56 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c191c52a-1a76-42ee-bcb3-7c75cef1a8e7 tempest-VolumesDeleteCascade-2130147687 None] Created volume successfully. Jul 03 01:14:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "cinder-46c990c0-921c-4aa0-b1e8-1ba94441c0b4-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-46c990c0-921c-4aa0-b1e8-1ba94441c0b4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Performing cascade delete. {{(pid=86772) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 03 01:14:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "cinder-aca6d5b2-2668-4e0c-9be1-68d523d706be-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-aca6d5b2-2668-4e0c-9be1-68d523d706be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "cinder-quobyte-46c990c0-921c-4aa0-b1e8-1ba94441c0b4" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-quobyte-46c990c0-921c-4aa0-b1e8-1ba94441c0b4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "cinder-quobyte-aca6d5b2-2668-4e0c-9be1-68d523d706be" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:14:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-quobyte-aca6d5b2-2668-4e0c-9be1-68d523d706be" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:14:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Deleting offline snapshot aca6d5b2-2668-4e0c-9be1-68d523d706be of volume 46c990c0-921c-4aa0-b1e8-1ba94441c0b4 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:14:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] snapshot_file for this snap is: volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.aca6d5b2-2668-4e0c-9be1-68d523d706be {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:14:57 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5 1073741824" returned: 0 in 0.918s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:57 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5548337e-1a2d-4440-ade1-aef63ae346ef]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.aca6d5b2-2668-4e0c-9be1-68d523d706be {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:57 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5 Jul 03 01:14:57 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:57 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.aca6d5b2-2668-4e0c-9be1-68d523d706be Jul 03 01:14:57 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:57 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5" returned: 0 in 0.695s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:14:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-e36ec9ad-1c32-465e-83a5-9ad9e9bd9614 req-79b3f2c4-5fe6-467d-b126-4c4b1b5d5f86 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.457s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d533038d-a374-430f-92d8-4e14d79aa50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fab90f28-2841-4f9b-afeb-bf63313aecd5', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2637d0a1-d712-489c-8eba-a4b4a7b67d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:14:57 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc53dca-394d-4156-90f2-27a62f573998]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-e36ec9ad-1c32-465e-83a5-9ad9e9bd9614 req-79b3f2c4-5fe6-467d-b126-4c4b1b5d5f86 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:57 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Volume volume-fab90f28-2841-4f9b-afeb-bf63313aecd5 (fab90f28-2841-4f9b-afeb-bf63313aecd5): created successfully Jul 03 01:14:57 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2637d0a1-d712-489c-8eba-a4b4a7b67d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:14:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Flow 'volume_create_manager' (6c826474-d4c2-42f0-bc58-cecaac97e3df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:14:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.aca6d5b2-2668-4e0c-9be1-68d523d706be" returned: 0 in 0.824s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:14:58 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-fd821018-5e8f-4b02-ab55-98244752216a req-c895adf4-41c7-408c-b1ef-45b87ad44aaa tempest-VolumesSnapshotsTestJSON-1862353149 None] Created volume successfully. Jul 03 01:14:58 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba5c96a-cdaa-4879-b2ec-ab20dc1fd9b3]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:58 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5 Jul 03 01:14:58 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:58 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4 Jul 03 01:14:58 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-c9e2fb34-e912-4a6b-9bc7-6d8f33ddf06c req-a3aff1da-8650-4352-8680-575c821a1c77 tempest-VolumesSnapshotsTestJSON-1862353149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:14:58 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-e36ec9ad-1c32-465e-83a5-9ad9e9bd9614 req-79b3f2c4-5fe6-467d-b126-4c4b1b5d5f86 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5" returned: 0 in 0.880s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-e36ec9ad-1c32-465e-83a5-9ad9e9bd9614 req-79b3f2c4-5fe6-467d-b126-4c4b1b5d5f86 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.915s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:14:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-c9e2fb34-e912-4a6b-9bc7-6d8f33ddf06c req-a3aff1da-8650-4352-8680-575c821a1c77 tempest-VolumesSnapshotsTestJSON-1862353149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.128s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:14:58 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [req-c9e2fb34-e912-4a6b-9bc7-6d8f33ddf06c req-a3aff1da-8650-4352-8680-575c821a1c77 tempest-VolumesSnapshotsTestJSON-1862353149 None] Creating offline snapshot 80a49e73-a5d9-446a-8ee5-959f1b91ce88 of volume fab90f28-2841-4f9b-afeb-bf63313aecd5 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:14:58 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7055aa5-15b8-4441-b5b3-694cf9b36014]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:14:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-c9e2fb34-e912-4a6b-9bc7-6d8f33ddf06c req-a3aff1da-8650-4352-8680-575c821a1c77 tempest-VolumesSnapshotsTestJSON-1862353149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-e36ec9ad-1c32-465e-83a5-9ad9e9bd9614 req-79b3f2c4-5fe6-467d-b126-4c4b1b5d5f86 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171', 'name': 'volume-ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3c85dbc6-a8f7-43df-aede-ebcc5e6cf9bd', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:14:58 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4" returned: 0 in 0.961s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.aca6d5b2-2668-4e0c-9be1-68d523d706be {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:59 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-e36ec9ad-1c32-465e-83a5-9ad9e9bd9614 req-79b3f2c4-5fe6-467d-b126-4c4b1b5d5f86 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] attachment_update completed successfully. Jul 03 01:14:59 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.aca6d5b2-2668-4e0c-9be1-68d523d706be Jul 03 01:14:59 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:59 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5 Jul 03 01:14:59 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:59 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-c9e2fb34-e912-4a6b-9bc7-6d8f33ddf06c req-a3aff1da-8650-4352-8680-575c821a1c77 tempest-VolumesSnapshotsTestJSON-1862353149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5" returned: 0 in 0.967s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-c9e2fb34-e912-4a6b-9bc7-6d8f33ddf06c req-a3aff1da-8650-4352-8680-575c821a1c77 tempest-VolumesSnapshotsTestJSON-1862353149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.80a49e73-a5d9-446a-8ee5-959f1b91ce88 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:59 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Jul 03 01:14:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.aca6d5b2-2668-4e0c-9be1-68d523d706be" returned: 0 in 0.898s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:14:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.aca6d5b2-2668-4e0c-9be1-68d523d706be {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:14:59 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.80a49e73-a5d9-446a-8ee5-959f1b91ce88 1G Jul 03 01:14:59 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:59 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.aca6d5b2-2668-4e0c-9be1-68d523d706be Jul 03 01:14:59 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:14:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-856dd302-3617-445c-ad3a-f17175327f68 req-2b7424d9-8d98-46ed-98ca-c6211c7e23dc tempest-TestInstancesWithCinderVolumes-1251159148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:00 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4.aca6d5b2-2668-4e0c-9be1-68d523d706be" returned: 0 in 0.763s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-quobyte-aca6d5b2-2668-4e0c-9be1-68d523d706be" released by "_delete_snapshot" :: held 3.552s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-quobyte-46c990c0-921c-4aa0-b1e8-1ba94441c0b4" released by "delete_snapshot" :: held 3.575s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:00 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Created reservations ['f9d42e4c-fdbc-4c94-bb99-9fb37b8afa50', 'ea27b8fb-836c-462a-9a4e-629ea4a9e15d', 'a14f31e6-59d5-4c46-8750-0bbdea4ee8b3', '84c37615-0ca3-4b5f-9d1b-68ece0eff0bc'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:15:00 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Delete snapshot completed successfully. Jul 03 01:15:00 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-c9e2fb34-e912-4a6b-9bc7-6d8f33ddf06c req-a3aff1da-8650-4352-8680-575c821a1c77 tempest-VolumesSnapshotsTestJSON-1862353149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.80a49e73-a5d9-446a-8ee5-959f1b91ce88 1G" returned: 0 in 0.963s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-c9e2fb34-e912-4a6b-9bc7-6d8f33ddf06c req-a3aff1da-8650-4352-8680-575c821a1c77 tempest-VolumesSnapshotsTestJSON-1862353149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fab90f28-2841-4f9b-afeb-bf63313aecd5 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.80a49e73-a5d9-446a-8ee5-959f1b91ce88 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-aca6d5b2-2668-4e0c-9be1-68d523d706be-delete_snapshot" released by "delete_snapshot" :: held 3.761s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Snapshots deleted, issuing volume delete {{(pid=86772) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 03 01:15:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "cinder-quobyte-46c990c0-921c-4aa0-b1e8-1ba94441c0b4" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:00 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fab90f28-2841-4f9b-afeb-bf63313aecd5 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.80a49e73-a5d9-446a-8ee5-959f1b91ce88 Jul 03 01:15:00 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-quobyte-46c990c0-921c-4aa0-b1e8-1ba94441c0b4" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:00 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cdf179-4a09-4488-a585-ed99c7a2067e]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:01 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4 Jul 03 01:15:01 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:01 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-c9e2fb34-e912-4a6b-9bc7-6d8f33ddf06c req-a3aff1da-8650-4352-8680-575c821a1c77 tempest-VolumesSnapshotsTestJSON-1862353149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fab90f28-2841-4f9b-afeb-bf63313aecd5 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.80a49e73-a5d9-446a-8ee5-959f1b91ce88" returned: 0 in 0.775s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:01 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [req-c9e2fb34-e912-4a6b-9bc7-6d8f33ddf06c req-a3aff1da-8650-4352-8680-575c821a1c77 tempest-VolumesSnapshotsTestJSON-1862353149 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.80a49e73-a5d9-446a-8ee5-959f1b91ce88 is being set with open permissions: ugo+rw Jul 03 01:15:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-c9e2fb34-e912-4a6b-9bc7-6d8f33ddf06c req-a3aff1da-8650-4352-8680-575c821a1c77 tempest-VolumesSnapshotsTestJSON-1862353149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.80a49e73-a5d9-446a-8ee5-959f1b91ce88 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:01 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.80a49e73-a5d9-446a-8ee5-959f1b91ce88 Jul 03 01:15:01 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:01 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4" returned: 0 in 0.837s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:01 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4 Jul 03 01:15:01 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:02 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-c9e2fb34-e912-4a6b-9bc7-6d8f33ddf06c req-a3aff1da-8650-4352-8680-575c821a1c77 tempest-VolumesSnapshotsTestJSON-1862353149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.80a49e73-a5d9-446a-8ee5-959f1b91ce88" returned: 0 in 0.658s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-c9e2fb34-e912-4a6b-9bc7-6d8f33ddf06c req-a3aff1da-8650-4352-8680-575c821a1c77 tempest-VolumesSnapshotsTestJSON-1862353149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:02 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.info Jul 03 01:15:02 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:02 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-46c990c0-921c-4aa0-b1e8-1ba94441c0b4" returned: 0 in 0.716s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-quobyte-46c990c0-921c-4aa0-b1e8-1ba94441c0b4" released by "delete_volume" :: held 1.627s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:02 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Created reservations ['7a416842-6e47-4630-b3aa-417edcad72a2', '7e54addb-4629-4e61-bb71-f7a53b8e7445', 'db0638a8-9622-4ffd-a84c-66f1e6d41a3c', '51b5fe63-e8c0-47c7-aa0f-e2ec7c97e060'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:15:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:02 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:15:02 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:02 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-c9e2fb34-e912-4a6b-9bc7-6d8f33ddf06c req-a3aff1da-8650-4352-8680-575c821a1c77 tempest-VolumesSnapshotsTestJSON-1862353149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.info" returned: 0 in 0.672s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:02 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [req-c9e2fb34-e912-4a6b-9bc7-6d8f33ddf06c req-a3aff1da-8650-4352-8680-575c821a1c77 tempest-VolumesSnapshotsTestJSON-1862353149 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.info is being set with open permissions: ugo+rw Jul 03 01:15:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-c9e2fb34-e912-4a6b-9bc7-6d8f33ddf06c req-a3aff1da-8650-4352-8680-575c821a1c77 tempest-VolumesSnapshotsTestJSON-1862353149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:03 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.info Jul 03 01:15:03 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:03 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.689s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:03 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:15:03 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Deleted volume successfully. Jul 03 01:15:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-58bede86-9b52-46fd-bb74-945ff67a7018 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-46c990c0-921c-4aa0-b1e8-1ba94441c0b4-delete_volume" released by "delete_volume" :: held 6.351s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:03 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-c9e2fb34-e912-4a6b-9bc7-6d8f33ddf06c req-a3aff1da-8650-4352-8680-575c821a1c77 tempest-VolumesSnapshotsTestJSON-1862353149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.info" returned: 0 in 0.651s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-c9e2fb34-e912-4a6b-9bc7-6d8f33ddf06c req-a3aff1da-8650-4352-8680-575c821a1c77 tempest-VolumesSnapshotsTestJSON-1862353149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.815s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-856dd302-3617-445c-ad3a-f17175327f68 req-2b7424d9-8d98-46ed-98ca-c6211c7e23dc tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.709s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:03 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f4658d-87d5-49a9-a243-324a87f12e2c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-856dd302-3617-445c-ad3a-f17175327f68 req-2b7424d9-8d98-46ed-98ca-c6211c7e23dc tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-620574b0-2e40-4fed-b0eb-b6f05b43b214 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:03 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-c9e2fb34-e912-4a6b-9bc7-6d8f33ddf06c req-a3aff1da-8650-4352-8680-575c821a1c77 tempest-VolumesSnapshotsTestJSON-1862353149 None] Create snapshot completed successfully Jul 03 01:15:03 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-620574b0-2e40-4fed-b0eb-b6f05b43b214 Jul 03 01:15:03 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:04 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-856dd302-3617-445c-ad3a-f17175327f68 req-2b7424d9-8d98-46ed-98ca-c6211c7e23dc tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-620574b0-2e40-4fed-b0eb-b6f05b43b214" returned: 0 in 0.802s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-856dd302-3617-445c-ad3a-f17175327f68 req-2b7424d9-8d98-46ed-98ca-c6211c7e23dc tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.826s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-0c0885fc-6142-449b-b516-b12aad7dc9a2 req-1fcdf8a7-23ae-49f9-908f-078e273caf12 tempest-VolumesSnapshotsTestJSON-1862353149 None] Acquiring lock "cinder-80a49e73-a5d9-446a-8ee5-959f1b91ce88-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-856dd302-3617-445c-ad3a-f17175327f68 req-2b7424d9-8d98-46ed-98ca-c6211c7e23dc tempest-TestInstancesWithCinderVolumes-1251159148 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171', 'name': 'volume-620574b0-2e40-4fed-b0eb-b6f05b43b214', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17801ff7-d65c-45f0-aa58-02dd510ab869', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:15:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-0c0885fc-6142-449b-b516-b12aad7dc9a2 req-1fcdf8a7-23ae-49f9-908f-078e273caf12 tempest-VolumesSnapshotsTestJSON-1862353149 None] Lock "cinder-80a49e73-a5d9-446a-8ee5-959f1b91ce88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-0c0885fc-6142-449b-b516-b12aad7dc9a2 req-1fcdf8a7-23ae-49f9-908f-078e273caf12 tempest-VolumesSnapshotsTestJSON-1862353149 None] Acquiring lock "cinder-quobyte-fab90f28-2841-4f9b-afeb-bf63313aecd5" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-0c0885fc-6142-449b-b516-b12aad7dc9a2 req-1fcdf8a7-23ae-49f9-908f-078e273caf12 tempest-VolumesSnapshotsTestJSON-1862353149 None] Lock "cinder-quobyte-fab90f28-2841-4f9b-afeb-bf63313aecd5" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-0c0885fc-6142-449b-b516-b12aad7dc9a2 req-1fcdf8a7-23ae-49f9-908f-078e273caf12 tempest-VolumesSnapshotsTestJSON-1862353149 None] Acquiring lock "cinder-quobyte-80a49e73-a5d9-446a-8ee5-959f1b91ce88" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-0c0885fc-6142-449b-b516-b12aad7dc9a2 req-1fcdf8a7-23ae-49f9-908f-078e273caf12 tempest-VolumesSnapshotsTestJSON-1862353149 None] Lock "cinder-quobyte-80a49e73-a5d9-446a-8ee5-959f1b91ce88" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [req-0c0885fc-6142-449b-b516-b12aad7dc9a2 req-1fcdf8a7-23ae-49f9-908f-078e273caf12 tempest-VolumesSnapshotsTestJSON-1862353149 None] Deleting offline snapshot 80a49e73-a5d9-446a-8ee5-959f1b91ce88 of volume fab90f28-2841-4f9b-afeb-bf63313aecd5 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:15:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [req-0c0885fc-6142-449b-b516-b12aad7dc9a2 req-1fcdf8a7-23ae-49f9-908f-078e273caf12 tempest-VolumesSnapshotsTestJSON-1862353149 None] snapshot_file for this snap is: volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.80a49e73-a5d9-446a-8ee5-959f1b91ce88 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:15:04 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-856dd302-3617-445c-ad3a-f17175327f68 req-2b7424d9-8d98-46ed-98ca-c6211c7e23dc tempest-TestInstancesWithCinderVolumes-1251159148 None] attachment_update completed successfully. Jul 03 01:15:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c96a5fbb-1bbb-405e-ae73-1a52e5a06606 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "cinder-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:04 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5128d01d-c7b3-4f2a-9743-dccd00316422]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c96a5fbb-1bbb-405e-ae73-1a52e5a06606 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-0c0885fc-6142-449b-b516-b12aad7dc9a2 req-1fcdf8a7-23ae-49f9-908f-078e273caf12 tempest-VolumesSnapshotsTestJSON-1862353149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.80a49e73-a5d9-446a-8ee5-959f1b91ce88 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c96a5fbb-1bbb-405e-ae73-1a52e5a06606 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "cinder-quobyte-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c96a5fbb-1bbb-405e-ae73-1a52e5a06606 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-quobyte-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:04 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[24552ea2-4b85-4bdb-adf1-b972f790cdf4]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c96a5fbb-1bbb-405e-ae73-1a52e5a06606 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:04 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.80a49e73-a5d9-446a-8ee5-959f1b91ce88 Jul 03 01:15:04 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:04 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e Jul 03 01:15:04 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:05 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-0c0885fc-6142-449b-b516-b12aad7dc9a2 req-1fcdf8a7-23ae-49f9-908f-078e273caf12 tempest-VolumesSnapshotsTestJSON-1862353149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.80a49e73-a5d9-446a-8ee5-959f1b91ce88" returned: 0 in 0.863s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [req-0c0885fc-6142-449b-b516-b12aad7dc9a2 req-1fcdf8a7-23ae-49f9-908f-078e273caf12 tempest-VolumesSnapshotsTestJSON-1862353149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fab90f28-2841-4f9b-afeb-bf63313aecd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:15:05 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6fa269-1aac-4bfd-94f4-effc75b7d86c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-0c0885fc-6142-449b-b516-b12aad7dc9a2 req-1fcdf8a7-23ae-49f9-908f-078e273caf12 tempest-VolumesSnapshotsTestJSON-1862353149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:05 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c96a5fbb-1bbb-405e-ae73-1a52e5a06606 tempest-VolumesDeleteCascade-2130147687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e" returned: 0 in 0.898s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c96a5fbb-1bbb-405e-ae73-1a52e5a06606 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:05 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e Jul 03 01:15:05 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:05 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5 Jul 03 01:15:05 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-cacdd201-399b-45f4-b7b5-862a235a1782 req-742a4c0d-ed4e-4d93-95c0-a626364b4739 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Terminate volume connection completed successfully. Jul 03 01:15:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-cacdd201-399b-45f4-b7b5-862a235a1782 req-742a4c0d-ed4e-4d93-95c0-a626364b4739 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Deleting attachment 3c85dbc6-a8f7-43df-aede-ebcc5e6cf9bd. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:15:06 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c96a5fbb-1bbb-405e-ae73-1a52e5a06606 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e" returned: 0 in 0.719s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c96a5fbb-1bbb-405e-ae73-1a52e5a06606 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-quobyte-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e" released by "delete_volume" :: held 1.662s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:06 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-c96a5fbb-1bbb-405e-ae73-1a52e5a06606 tempest-VolumesDeleteCascade-2130147687 None] Created reservations ['6564310e-c161-4178-be09-94f1a3f79e13', '8940a237-f64c-46b2-a61f-f28745f550ab', '1ac1b3b3-49b1-4d7a-bdd5-c9bc115b0538', '998f3b91-92cd-43b4-86d9-73ac1e389bc9'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:15:06 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-0c0885fc-6142-449b-b516-b12aad7dc9a2 req-1fcdf8a7-23ae-49f9-908f-078e273caf12 tempest-VolumesSnapshotsTestJSON-1862353149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5" returned: 0 in 0.898s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-0c0885fc-6142-449b-b516-b12aad7dc9a2 req-1fcdf8a7-23ae-49f9-908f-078e273caf12 tempest-VolumesSnapshotsTestJSON-1862353149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.80a49e73-a5d9-446a-8ee5-959f1b91ce88 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:06 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.80a49e73-a5d9-446a-8ee5-959f1b91ce88 Jul 03 01:15:06 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c96a5fbb-1bbb-405e-ae73-1a52e5a06606 tempest-VolumesDeleteCascade-2130147687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c96a5fbb-1bbb-405e-ae73-1a52e5a06606 tempest-VolumesDeleteCascade-2130147687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c96a5fbb-1bbb-405e-ae73-1a52e5a06606 tempest-VolumesDeleteCascade-2130147687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c96a5fbb-1bbb-405e-ae73-1a52e5a06606 tempest-VolumesDeleteCascade-2130147687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c96a5fbb-1bbb-405e-ae73-1a52e5a06606 tempest-VolumesDeleteCascade-2130147687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c96a5fbb-1bbb-405e-ae73-1a52e5a06606 tempest-VolumesDeleteCascade-2130147687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:06 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:15:06 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:07 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-0c0885fc-6142-449b-b516-b12aad7dc9a2 req-1fcdf8a7-23ae-49f9-908f-078e273caf12 tempest-VolumesSnapshotsTestJSON-1862353149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.80a49e73-a5d9-446a-8ee5-959f1b91ce88" returned: 0 in 0.808s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-0c0885fc-6142-449b-b516-b12aad7dc9a2 req-1fcdf8a7-23ae-49f9-908f-078e273caf12 tempest-VolumesSnapshotsTestJSON-1862353149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.80a49e73-a5d9-446a-8ee5-959f1b91ce88 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:07 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.80a49e73-a5d9-446a-8ee5-959f1b91ce88 Jul 03 01:15:07 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:07 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c96a5fbb-1bbb-405e-ae73-1a52e5a06606 tempest-VolumesDeleteCascade-2130147687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.772s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:07 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-c96a5fbb-1bbb-405e-ae73-1a52e5a06606 tempest-VolumesDeleteCascade-2130147687 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:15:07 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c96a5fbb-1bbb-405e-ae73-1a52e5a06606 tempest-VolumesDeleteCascade-2130147687 None] Deleted volume successfully. Jul 03 01:15:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c96a5fbb-1bbb-405e-ae73-1a52e5a06606 tempest-VolumesDeleteCascade-2130147687 None] Lock "cinder-99c6bcdc-c5c7-4d27-96d1-f7421f1e087e-delete_volume" released by "delete_volume" :: held 2.706s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:08 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-0c0885fc-6142-449b-b516-b12aad7dc9a2 req-1fcdf8a7-23ae-49f9-908f-078e273caf12 tempest-VolumesSnapshotsTestJSON-1862353149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5.80a49e73-a5d9-446a-8ee5-959f1b91ce88" returned: 0 in 0.788s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-688fa0b3-81ed-4ff5-b69e-7305356e8ff5 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Acquiring lock "cinder-ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-0c0885fc-6142-449b-b516-b12aad7dc9a2 req-1fcdf8a7-23ae-49f9-908f-078e273caf12 tempest-VolumesSnapshotsTestJSON-1862353149 None] Lock "cinder-quobyte-80a49e73-a5d9-446a-8ee5-959f1b91ce88" released by "_delete_snapshot" :: held 3.508s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-0c0885fc-6142-449b-b516-b12aad7dc9a2 req-1fcdf8a7-23ae-49f9-908f-078e273caf12 tempest-VolumesSnapshotsTestJSON-1862353149 None] Lock "cinder-quobyte-fab90f28-2841-4f9b-afeb-bf63313aecd5" released by "delete_snapshot" :: held 3.545s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-688fa0b3-81ed-4ff5-b69e-7305356e8ff5 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Lock "cinder-ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-688fa0b3-81ed-4ff5-b69e-7305356e8ff5 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Acquiring lock "cinder-quobyte-ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-688fa0b3-81ed-4ff5-b69e-7305356e8ff5 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Lock "cinder-quobyte-ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5" acquired by "delete_volume" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:08 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1956c859-7c20-48bc-9610-8715a9a12d53]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-688fa0b3-81ed-4ff5-b69e-7305356e8ff5 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:08 devstack cinder-volume[86772]: DEBUG cinder.quota [req-0c0885fc-6142-449b-b516-b12aad7dc9a2 req-1fcdf8a7-23ae-49f9-908f-078e273caf12 tempest-VolumesSnapshotsTestJSON-1862353149 None] Created reservations ['3d221544-ed66-40aa-ab67-e38aa1ecaf76', '68747420-cb6b-4c48-812b-166dd0e25532', 'a1854428-11fb-4819-8062-3b2ea24cfd9b', '26f27fed-7025-4ff2-a115-e4e7fcf34524'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:15:08 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-0c0885fc-6142-449b-b516-b12aad7dc9a2 req-1fcdf8a7-23ae-49f9-908f-078e273caf12 tempest-VolumesSnapshotsTestJSON-1862353149 None] Delete snapshot completed successfully. Jul 03 01:15:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-0c0885fc-6142-449b-b516-b12aad7dc9a2 req-1fcdf8a7-23ae-49f9-908f-078e273caf12 tempest-VolumesSnapshotsTestJSON-1862353149 None] Lock "cinder-80a49e73-a5d9-446a-8ee5-959f1b91ce88-delete_snapshot" released by "delete_snapshot" :: held 3.787s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:08 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5 Jul 03 01:15:08 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-7ed5091e-0f15-4c2c-8318-fbfcc9db7330 req-d83dc127-7116-4f05-ba25-7435bbc1ae23 tempest-VolumesSnapshotsTestJSON-1862353149 None] Acquiring lock "cinder-fab90f28-2841-4f9b-afeb-bf63313aecd5-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-7ed5091e-0f15-4c2c-8318-fbfcc9db7330 req-d83dc127-7116-4f05-ba25-7435bbc1ae23 tempest-VolumesSnapshotsTestJSON-1862353149 None] Lock "cinder-fab90f28-2841-4f9b-afeb-bf63313aecd5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-7ed5091e-0f15-4c2c-8318-fbfcc9db7330 req-d83dc127-7116-4f05-ba25-7435bbc1ae23 tempest-VolumesSnapshotsTestJSON-1862353149 None] Acquiring lock "cinder-quobyte-fab90f28-2841-4f9b-afeb-bf63313aecd5" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-7ed5091e-0f15-4c2c-8318-fbfcc9db7330 req-d83dc127-7116-4f05-ba25-7435bbc1ae23 tempest-VolumesSnapshotsTestJSON-1862353149 None] Lock "cinder-quobyte-fab90f28-2841-4f9b-afeb-bf63313aecd5" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:09 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[21058a65-b1eb-44e9-9073-604d05202c31]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-7ed5091e-0f15-4c2c-8318-fbfcc9db7330 req-d83dc127-7116-4f05-ba25-7435bbc1ae23 tempest-VolumesSnapshotsTestJSON-1862353149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:09 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-688fa0b3-81ed-4ff5-b69e-7305356e8ff5 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5" returned: 0 in 0.926s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-688fa0b3-81ed-4ff5-b69e-7305356e8ff5 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:09 devstack sudo[99826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5 Jul 03 01:15:09 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:09 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5 Jul 03 01:15:09 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:09 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-688fa0b3-81ed-4ff5-b69e-7305356e8ff5 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5" returned: 0 in 0.706s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-688fa0b3-81ed-4ff5-b69e-7305356e8ff5 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Lock "cinder-quobyte-ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5" released by "delete_volume" :: held 1.688s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:10 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-688fa0b3-81ed-4ff5-b69e-7305356e8ff5 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Created reservations ['027455f7-22f4-4e55-8b14-249eef920be3', '5af0d2bc-9f67-4cf1-ad6c-e4292059bab5', 'e6ef5eb5-ffe4-4140-b8e8-e400f30be5c4', '089c830b-0fd6-40b3-8fa5-315287e1c36a'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:15:10 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-7ed5091e-0f15-4c2c-8318-fbfcc9db7330 req-d83dc127-7116-4f05-ba25-7435bbc1ae23 tempest-VolumesSnapshotsTestJSON-1862353149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5" returned: 0 in 0.901s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-7ed5091e-0f15-4c2c-8318-fbfcc9db7330 req-d83dc127-7116-4f05-ba25-7435bbc1ae23 tempest-VolumesSnapshotsTestJSON-1862353149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:10 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5 Jul 03 01:15:10 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-688fa0b3-81ed-4ff5-b69e-7305356e8ff5 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-688fa0b3-81ed-4ff5-b69e-7305356e8ff5 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-688fa0b3-81ed-4ff5-b69e-7305356e8ff5 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-688fa0b3-81ed-4ff5-b69e-7305356e8ff5 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-688fa0b3-81ed-4ff5-b69e-7305356e8ff5 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-688fa0b3-81ed-4ff5-b69e-7305356e8ff5 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:10 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:15:10 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:11 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-688fa0b3-81ed-4ff5-b69e-7305356e8ff5 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.846s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:11 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-688fa0b3-81ed-4ff5-b69e-7305356e8ff5 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:15:11 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-688fa0b3-81ed-4ff5-b69e-7305356e8ff5 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Deleted volume successfully. Jul 03 01:15:11 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-7ed5091e-0f15-4c2c-8318-fbfcc9db7330 req-d83dc127-7116-4f05-ba25-7435bbc1ae23 tempest-VolumesSnapshotsTestJSON-1862353149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fab90f28-2841-4f9b-afeb-bf63313aecd5" returned: 0 in 0.952s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-7ed5091e-0f15-4c2c-8318-fbfcc9db7330 req-d83dc127-7116-4f05-ba25-7435bbc1ae23 tempest-VolumesSnapshotsTestJSON-1862353149 None] Lock "cinder-quobyte-fab90f28-2841-4f9b-afeb-bf63313aecd5" released by "delete_volume" :: held 1.937s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-688fa0b3-81ed-4ff5-b69e-7305356e8ff5 tempest-TestServerVolumeAttachScenarioOldVersion-1174855786 None] Lock "cinder-ec1e0bdb-1154-4b1b-8f28-ec40c925cbe5-delete_volume" released by "delete_volume" :: held 2.883s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:11 devstack cinder-volume[86772]: DEBUG cinder.quota [req-7ed5091e-0f15-4c2c-8318-fbfcc9db7330 req-d83dc127-7116-4f05-ba25-7435bbc1ae23 tempest-VolumesSnapshotsTestJSON-1862353149 None] Created reservations ['a2a24780-dcb1-4341-83e4-e44a05eb6ba5', 'a4946e70-59a7-40e4-ae31-854905369451', 'edaf5f33-2e99-4494-9734-738686e2cda2', '7e1fbe4e-087b-49e4-9551-a589e37d3cec'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:15:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-7ed5091e-0f15-4c2c-8318-fbfcc9db7330 req-d83dc127-7116-4f05-ba25-7435bbc1ae23 tempest-VolumesSnapshotsTestJSON-1862353149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-7ed5091e-0f15-4c2c-8318-fbfcc9db7330 req-d83dc127-7116-4f05-ba25-7435bbc1ae23 tempest-VolumesSnapshotsTestJSON-1862353149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-7ed5091e-0f15-4c2c-8318-fbfcc9db7330 req-d83dc127-7116-4f05-ba25-7435bbc1ae23 tempest-VolumesSnapshotsTestJSON-1862353149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-7ed5091e-0f15-4c2c-8318-fbfcc9db7330 req-d83dc127-7116-4f05-ba25-7435bbc1ae23 tempest-VolumesSnapshotsTestJSON-1862353149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-7ed5091e-0f15-4c2c-8318-fbfcc9db7330 req-d83dc127-7116-4f05-ba25-7435bbc1ae23 tempest-VolumesSnapshotsTestJSON-1862353149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-7ed5091e-0f15-4c2c-8318-fbfcc9db7330 req-d83dc127-7116-4f05-ba25-7435bbc1ae23 tempest-VolumesSnapshotsTestJSON-1862353149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:11 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:15:11 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:12 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-7ed5091e-0f15-4c2c-8318-fbfcc9db7330 req-d83dc127-7116-4f05-ba25-7435bbc1ae23 tempest-VolumesSnapshotsTestJSON-1862353149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.879s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG cinder.manager [req-7ed5091e-0f15-4c2c-8318-fbfcc9db7330 req-d83dc127-7116-4f05-ba25-7435bbc1ae23 tempest-VolumesSnapshotsTestJSON-1862353149 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:15:12 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-7ed5091e-0f15-4c2c-8318-fbfcc9db7330 req-d83dc127-7116-4f05-ba25-7435bbc1ae23 tempest-VolumesSnapshotsTestJSON-1862353149 None] Deleted volume successfully. Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-7ed5091e-0f15-4c2c-8318-fbfcc9db7330 req-d83dc127-7116-4f05-ba25-7435bbc1ae23 tempest-VolumesSnapshotsTestJSON-1862353149 None] Lock "cinder-fab90f28-2841-4f9b-afeb-bf63313aecd5-delete_volume" released by "delete_volume" :: held 3.061s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Flow 'volume_create_manager' (650653db-3b17-41cc-bece-e4f80e1c6b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c444945-e116-4ad9-a773-5ed6b266e21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c444945-e116-4ad9-a773-5ed6b266e21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-189698533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1ba38b1-0488-421c-85c3-4669f179c2de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a75307b0b774b7f952874653458b2d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:13Z,use_quota=True,user_id='89e3bb1160ce4c47b98f96d4cedf8465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce5b7dc1-4702-44d1-95a9-adbacf0a81b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce5b7dc1-4702-44d1-95a9-adbacf0a81b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d721790-b113-470a-bfda-df68d590af29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d721790-b113-470a-bfda-df68d590af29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1ba38b1-0488-421c-85c3-4669f179c2de', 'volume_name': 'volume-c1ba38b1-0488-421c-85c3-4669f179c2de', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8032cdb3-927a-43d2-bcf1-2b3400d8a3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8032cdb3-927a-43d2-bcf1-2b3400d8a3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e4ad110-acc8-4959-99f4-f5fc913f5a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:12 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Volume c1ba38b1-0488-421c-85c3-4669f179c2de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1ba38b1-0488-421c-85c3-4669f179c2de', 'volume_size': 1} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-189698533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1ba38b1-0488-421c-85c3-4669f179c2de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a75307b0b774b7f952874653458b2d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:13Z,use_quota=True,user_id='89e3bb1160ce4c47b98f96d4cedf8465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Creating volume c1ba38b1-0488-421c-85c3-4669f179c2de {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:15:12 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1ba38b1-0488-421c-85c3-4669f179c2de 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:12 devstack sudo[99892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1ba38b1-0488-421c-85c3-4669f179c2de 1073741824 Jul 03 01:15:12 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:12 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:15:12 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-cad0647a-2042-40fe-8100-913d45244690 req-9d52b14b-23b2-449b-8d57-120646d6dbe0 tempest-TestInstancesWithCinderVolumes-1251159148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:13 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.964s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:15:13 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:15:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:15:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:15:13 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1ba38b1-0488-421c-85c3-4669f179c2de 1073741824" returned: 0 in 1.204s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1ba38b1-0488-421c-85c3-4669f179c2de {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:14 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1ba38b1-0488-421c-85c3-4669f179c2de Jul 03 01:15:14 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:14 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1ba38b1-0488-421c-85c3-4669f179c2de" returned: 0 in 0.850s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] <== create_volume: return (2117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:15:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.120s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-cad0647a-2042-40fe-8100-913d45244690 req-9d52b14b-23b2-449b-8d57-120646d6dbe0 tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.318s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:14 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=90,cinder:UPDATE=109,cinder:INSERT=29,cinder:DELETE=7 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:15:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e4ad110-acc8-4959-99f4-f5fc913f5a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1ba38b1-0488-421c-85c3-4669f179c2de', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55dd9437-cbcb-4488-a0d3-20629b0818b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:14 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[11032b2a-3285-4d8b-b52e-ef84910d8037]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-cad0647a-2042-40fe-8100-913d45244690 req-9d52b14b-23b2-449b-8d57-120646d6dbe0 tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-716d9866-9ed6-48da-a674-79333be076df {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:14 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=106,cinder:UPDATE=106,cinder:DELETE=8,cinder:INSERT=25 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:15:14 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Volume volume-c1ba38b1-0488-421c-85c3-4669f179c2de (c1ba38b1-0488-421c-85c3-4669f179c2de): created successfully Jul 03 01:15:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55dd9437-cbcb-4488-a0d3-20629b0818b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Flow 'volume_create_manager' (650653db-3b17-41cc-bece-e4f80e1c6b84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:15:14 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-97646d6c-fbac-4be1-9da8-b3ff146cbb9c tempest-VolumesTransfersTest-1151575425 None] Created volume successfully. Jul 03 01:15:15 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-716d9866-9ed6-48da-a674-79333be076df Jul 03 01:15:15 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:15 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-cad0647a-2042-40fe-8100-913d45244690 req-9d52b14b-23b2-449b-8d57-120646d6dbe0 tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-716d9866-9ed6-48da-a674-79333be076df" returned: 0 in 0.821s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-cad0647a-2042-40fe-8100-913d45244690 req-9d52b14b-23b2-449b-8d57-120646d6dbe0 tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.853s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-cad0647a-2042-40fe-8100-913d45244690 req-9d52b14b-23b2-449b-8d57-120646d6dbe0 tempest-TestInstancesWithCinderVolumes-1251159148 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171', 'name': 'volume-716d9866-9ed6-48da-a674-79333be076df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c33dbcf-d054-4cd2-8a7f-df90d08693ce', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:15:15 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-cad0647a-2042-40fe-8100-913d45244690 req-9d52b14b-23b2-449b-8d57-120646d6dbe0 tempest-TestInstancesWithCinderVolumes-1251159148 None] attachment_update completed successfully. Jul 03 01:15:16 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-83e69ab0-f8f5-41b5-a00b-1a79884b5043 tempest-VolumesTransfersTest-1127124709 None] Transfer volume completed successfully. Jul 03 01:15:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f707c7f6-6942-452b-b8ff-3b8a1ab99f39 tempest-VolumesTransfersTest-1774535415 None] Acquiring lock "cinder-c1ba38b1-0488-421c-85c3-4669f179c2de-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f707c7f6-6942-452b-b8ff-3b8a1ab99f39 tempest-VolumesTransfersTest-1774535415 None] Lock "cinder-c1ba38b1-0488-421c-85c3-4669f179c2de-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f707c7f6-6942-452b-b8ff-3b8a1ab99f39 tempest-VolumesTransfersTest-1774535415 None] Acquiring lock "cinder-quobyte-c1ba38b1-0488-421c-85c3-4669f179c2de" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f707c7f6-6942-452b-b8ff-3b8a1ab99f39 tempest-VolumesTransfersTest-1774535415 None] Lock "cinder-quobyte-c1ba38b1-0488-421c-85c3-4669f179c2de" acquired by "delete_volume" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:17 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92857ff-eddd-471b-9397-1aacf880cb61]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f707c7f6-6942-452b-b8ff-3b8a1ab99f39 tempest-VolumesTransfersTest-1774535415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1ba38b1-0488-421c-85c3-4669f179c2de {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:18 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1ba38b1-0488-421c-85c3-4669f179c2de Jul 03 01:15:18 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:18 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f707c7f6-6942-452b-b8ff-3b8a1ab99f39 tempest-VolumesTransfersTest-1774535415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1ba38b1-0488-421c-85c3-4669f179c2de" returned: 0 in 0.836s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f707c7f6-6942-452b-b8ff-3b8a1ab99f39 tempest-VolumesTransfersTest-1774535415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1ba38b1-0488-421c-85c3-4669f179c2de {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:18 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1ba38b1-0488-421c-85c3-4669f179c2de Jul 03 01:15:18 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:19 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f707c7f6-6942-452b-b8ff-3b8a1ab99f39 tempest-VolumesTransfersTest-1774535415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1ba38b1-0488-421c-85c3-4669f179c2de" returned: 0 in 0.830s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f707c7f6-6942-452b-b8ff-3b8a1ab99f39 tempest-VolumesTransfersTest-1774535415 None] Lock "cinder-quobyte-c1ba38b1-0488-421c-85c3-4669f179c2de" released by "delete_volume" :: held 1.723s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:19 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-f707c7f6-6942-452b-b8ff-3b8a1ab99f39 tempest-VolumesTransfersTest-1774535415 None] Created reservations ['f4d38df3-475f-4c13-b02a-681733f663e4', '70ca2ae7-df68-4f02-9a36-0ed75083dd8c', '60fec07f-c353-4d83-a0aa-2676aa3c3c2e', 'e9c5aafe-bbe2-4146-8828-a37dd771aac5'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:15:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f707c7f6-6942-452b-b8ff-3b8a1ab99f39 tempest-VolumesTransfersTest-1774535415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f707c7f6-6942-452b-b8ff-3b8a1ab99f39 tempest-VolumesTransfersTest-1774535415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f707c7f6-6942-452b-b8ff-3b8a1ab99f39 tempest-VolumesTransfersTest-1774535415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f707c7f6-6942-452b-b8ff-3b8a1ab99f39 tempest-VolumesTransfersTest-1774535415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f707c7f6-6942-452b-b8ff-3b8a1ab99f39 tempest-VolumesTransfersTest-1774535415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f707c7f6-6942-452b-b8ff-3b8a1ab99f39 tempest-VolumesTransfersTest-1774535415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:19 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:15:19 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:20 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f707c7f6-6942-452b-b8ff-3b8a1ab99f39 tempest-VolumesTransfersTest-1774535415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.812s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:20 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-f707c7f6-6942-452b-b8ff-3b8a1ab99f39 tempest-VolumesTransfersTest-1774535415 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:15:20 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f707c7f6-6942-452b-b8ff-3b8a1ab99f39 tempest-VolumesTransfersTest-1774535415 None] Deleted volume successfully. Jul 03 01:15:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f707c7f6-6942-452b-b8ff-3b8a1ab99f39 tempest-VolumesTransfersTest-1774535415 None] Lock "cinder-c1ba38b1-0488-421c-85c3-4669f179c2de-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:20 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:15:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Flow 'volume_create_manager' (0e1ee422-20c1-4a22-bd4b-18dd8ec36aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:15:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52e243c-f340-4ad5-9634-5e5edc66ca34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52e243c-f340-4ad5-9634-5e5edc66ca34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-22278451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b44844c-73a2-48af-b97b-832b253d0ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a75307b0b774b7f952874653458b2d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:21Z,use_quota=True,user_id='89e3bb1160ce4c47b98f96d4cedf8465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2afff5b1-e95d-4b9b-9c6a-baac4b1f55a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2afff5b1-e95d-4b9b-9c6a-baac4b1f55a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (199d9213-9ea8-4a79-8f97-47c993ea492d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (199d9213-9ea8-4a79-8f97-47c993ea492d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b44844c-73a2-48af-b97b-832b253d0ff0', 'volume_name': 'volume-0b44844c-73a2-48af-b97b-832b253d0ff0', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f74b48-2dc1-4d3e-b27b-28114eab188e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f74b48-2dc1-4d3e-b27b-28114eab188e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98baba35-2b29-46cf-a448-5417cefb8ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:20 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Volume 0b44844c-73a2-48af-b97b-832b253d0ff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b44844c-73a2-48af-b97b-832b253d0ff0', 'volume_size': 1} Jul 03 01:15:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-22278451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b44844c-73a2-48af-b97b-832b253d0ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a75307b0b774b7f952874653458b2d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:21Z,use_quota=True,user_id='89e3bb1160ce4c47b98f96d4cedf8465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:15:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Creating volume 0b44844c-73a2-48af-b97b-832b253d0ff0 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:15:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:15:20 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:15:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0b44844c-73a2-48af-b97b-832b253d0ff0 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:21 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0b44844c-73a2-48af-b97b-832b253d0ff0 1073741824 Jul 03 01:15:21 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:21 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c2cd0104-bdf4-45ea-ac31-ec47c61157c7 tempest-GroupSnapshotsTest-1965032115 None] Group tempest-GroupSnapshotsTest-Group-2001295720: creating Jul 03 01:15:21 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c2cd0104-bdf4-45ea-ac31-ec47c61157c7 tempest-GroupSnapshotsTest-1965032115 None] Group tempest-GroupSnapshotsTest-Group-2001295720: created successfully Jul 03 01:15:21 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c2cd0104-bdf4-45ea-ac31-ec47c61157c7 tempest-GroupSnapshotsTest-1965032115 None] Create group completed successfully. Jul 03 01:15:22 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0b44844c-73a2-48af-b97b-832b253d0ff0 1073741824" returned: 0 in 1.146s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0b44844c-73a2-48af-b97b-832b253d0ff0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:22 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0b44844c-73a2-48af-b97b-832b253d0ff0 Jul 03 01:15:22 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:23 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0b44844c-73a2-48af-b97b-832b253d0ff0" returned: 0 in 0.868s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] <== create_volume: return (2085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.098s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98baba35-2b29-46cf-a448-5417cefb8ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b44844c-73a2-48af-b97b-832b253d0ff0', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f7db05-0c54-4e6c-a164-5047f2888af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:23 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Volume volume-0b44844c-73a2-48af-b97b-832b253d0ff0 (0b44844c-73a2-48af-b97b-832b253d0ff0): created successfully Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f7db05-0c54-4e6c-a164-5047f2888af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Flow 'volume_create_manager' (0e1ee422-20c1-4a22-bd4b-18dd8ec36aeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:15:23 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4fff30ab-679c-4383-a01a-ead8779222fe tempest-VolumesTransfersTest-1151575425 None] Created volume successfully. Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Flow 'volume_create_manager' (9db5a0ed-f560-4396-9efe-12d2279bf2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66942eea-5223-4e23-88c1-9fd59bea5ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66942eea-5223-4e23-88c1-9fd59bea5ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-692477951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ce99aca6-2f11-43f9-bce9-04848abb4860,host='devstack@QuobyteHD#QuobyteHD',id=8fdcb017-d576-487d-a0c4-8500d23df51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b94b8cf214470d8051e79c2d7bd31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:23Z,use_quota=True,user_id='fc5464344d954c808bfe53ee61e72184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a383ae7-4e32-4986-9373-8d5b1c5619b7),volume_type_id=3a383ae7-4e32-4986-9373-8d5b1c5619b7)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ec1b66-3a0a-4550-a01c-c50ab5ae328a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ec1b66-3a0a-4550-a01c-c50ab5ae328a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77be38b-f0e8-44cd-bba7-a09070bc2220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77be38b-f0e8-44cd-bba7-a09070bc2220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fdcb017-d576-487d-a0c4-8500d23df51e', 'volume_name': 'volume-8fdcb017-d576-487d-a0c4-8500d23df51e', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35bf731e-6bc6-44d8-84f7-d4a1effafdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35bf731e-6bc6-44d8-84f7-d4a1effafdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2243003c-a72f-48ab-9701-23b54ba413f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:23 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Volume 8fdcb017-d576-487d-a0c4-8500d23df51e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fdcb017-d576-487d-a0c4-8500d23df51e', 'volume_size': 1} Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ce99aca6-2f11-43f9-bce9-04848abb4860,created_at=2026-07-02T23:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-692477951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ce99aca6-2f11-43f9-bce9-04848abb4860,host='devstack@QuobyteHD#QuobyteHD',id=8fdcb017-d576-487d-a0c4-8500d23df51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b94b8cf214470d8051e79c2d7bd31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:23Z,use_quota=True,user_id='fc5464344d954c808bfe53ee61e72184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a383ae7-4e32-4986-9373-8d5b1c5619b7),volume_type_id=3a383ae7-4e32-4986-9373-8d5b1c5619b7)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Creating volume 8fdcb017-d576-487d-a0c4-8500d23df51e {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:15:23 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:15:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:23 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e 1073741824 Jul 03 01:15:23 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3ead9ef3-f3f4-4f44-b903-2c980d00f4d6 tempest-VolumesTransfersTest-1774535415 None] Acquiring lock "cinder-0b44844c-73a2-48af-b97b-832b253d0ff0-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3ead9ef3-f3f4-4f44-b903-2c980d00f4d6 tempest-VolumesTransfersTest-1774535415 None] Lock "cinder-0b44844c-73a2-48af-b97b-832b253d0ff0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3ead9ef3-f3f4-4f44-b903-2c980d00f4d6 tempest-VolumesTransfersTest-1774535415 None] Acquiring lock "cinder-quobyte-0b44844c-73a2-48af-b97b-832b253d0ff0" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3ead9ef3-f3f4-4f44-b903-2c980d00f4d6 tempest-VolumesTransfersTest-1774535415 None] Lock "cinder-quobyte-0b44844c-73a2-48af-b97b-832b253d0ff0" acquired by "delete_volume" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:24 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e 1073741824" returned: 0 in 1.168s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:24 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8da801-0211-4aea-957f-cb0b93c94171]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ead9ef3-f3f4-4f44-b903-2c980d00f4d6 tempest-VolumesTransfersTest-1774535415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0b44844c-73a2-48af-b97b-832b253d0ff0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:24 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e Jul 03 01:15:24 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:24 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0b44844c-73a2-48af-b97b-832b253d0ff0 Jul 03 01:15:24 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:25 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ead9ef3-f3f4-4f44-b903-2c980d00f4d6 tempest-VolumesTransfersTest-1774535415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0b44844c-73a2-48af-b97b-832b253d0ff0" returned: 0 in 1.081s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ead9ef3-f3f4-4f44-b903-2c980d00f4d6 tempest-VolumesTransfersTest-1774535415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0b44844c-73a2-48af-b97b-832b253d0ff0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:25 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0b44844c-73a2-48af-b97b-832b253d0ff0 Jul 03 01:15:25 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:25 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e" returned: 0 in 1.116s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] <== create_volume: return (2364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:15:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.367s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2243003c-a72f-48ab-9701-23b54ba413f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fdcb017-d576-487d-a0c4-8500d23df51e', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (159a07d7-bab9-4bbc-946c-73e7d904efd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:25 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Volume volume-8fdcb017-d576-487d-a0c4-8500d23df51e (8fdcb017-d576-487d-a0c4-8500d23df51e): created successfully Jul 03 01:15:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (159a07d7-bab9-4bbc-946c-73e7d904efd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Flow 'volume_create_manager' (9db5a0ed-f560-4396-9efe-12d2279bf2c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:15:25 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6eb7af0c-28d3-4b45-b808-73d0d4660fac tempest-GroupSnapshotsTest-1965032115 None] Created volume successfully. Jul 03 01:15:26 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ead9ef3-f3f4-4f44-b903-2c980d00f4d6 tempest-VolumesTransfersTest-1774535415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0b44844c-73a2-48af-b97b-832b253d0ff0" returned: 0 in 0.791s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3ead9ef3-f3f4-4f44-b903-2c980d00f4d6 tempest-VolumesTransfersTest-1774535415 None] Lock "cinder-quobyte-0b44844c-73a2-48af-b97b-832b253d0ff0" released by "delete_volume" :: held 1.930s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:26 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-3ead9ef3-f3f4-4f44-b903-2c980d00f4d6 tempest-VolumesTransfersTest-1774535415 None] Created reservations ['e97c39dd-08ca-44b6-a79f-9b30d7c6d88f', '8b51e471-38e0-44aa-8f46-9f3a8d47a02d', '6375fb84-5298-4d6c-a711-85d25df0d86d', '5c8b1643-2db0-4c6a-a482-9729feae794a'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:15:26 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-0dbf1ddf-c1c2-46db-8bc1-f90a9d850374 req-f8eb54e4-ac49-49ce-a681-d5feb2426486 tempest-TestInstancesWithCinderVolumes-1251159148 None] Terminate volume connection completed successfully. Jul 03 01:15:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-0dbf1ddf-c1c2-46db-8bc1-f90a9d850374 req-f8eb54e4-ac49-49ce-a681-d5feb2426486 tempest-TestInstancesWithCinderVolumes-1251159148 None] Deleting attachment 17801ff7-d65c-45f0-aa58-02dd510ab869. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:15:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3ead9ef3-f3f4-4f44-b903-2c980d00f4d6 tempest-VolumesTransfersTest-1774535415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3ead9ef3-f3f4-4f44-b903-2c980d00f4d6 tempest-VolumesTransfersTest-1774535415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3ead9ef3-f3f4-4f44-b903-2c980d00f4d6 tempest-VolumesTransfersTest-1774535415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3ead9ef3-f3f4-4f44-b903-2c980d00f4d6 tempest-VolumesTransfersTest-1774535415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3ead9ef3-f3f4-4f44-b903-2c980d00f4d6 tempest-VolumesTransfersTest-1774535415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ead9ef3-f3f4-4f44-b903-2c980d00f4d6 tempest-VolumesTransfersTest-1774535415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:26 devstack sudo[100041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:15:26 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:27 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3da9e370-027d-40de-859a-a3bca00f92cd tempest-GroupSnapshotsTest-1965032115 None] GroupSnapshot 4e677450-06c6-41e4-89f4-aee47c6b2683: creating. Jul 03 01:15:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3da9e370-027d-40de-859a-a3bca00f92cd tempest-GroupSnapshotsTest-1965032115 None] Group snapshot 4e677450-06c6-41e4-89f4-aee47c6b2683: creating. {{(pid=86772) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 01:15:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3da9e370-027d-40de-859a-a3bca00f92cd tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3da9e370-027d-40de-859a-a3bca00f92cd tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3da9e370-027d-40de-859a-a3bca00f92cd tempest-GroupSnapshotsTest-1965032115 None] Creating offline snapshot 8acd004d-df87-41b3-94dc-4481c4a67311 of volume 8fdcb017-d576-487d-a0c4-8500d23df51e {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:15:27 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[209aaa73-e89b-4c26-a398-8fbc2d78581c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3da9e370-027d-40de-859a-a3bca00f92cd tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:27 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e Jul 03 01:15:27 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:27 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3ead9ef3-f3f4-4f44-b903-2c980d00f4d6 tempest-VolumesTransfersTest-1774535415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.943s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:27 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-3ead9ef3-f3f4-4f44-b903-2c980d00f4d6 tempest-VolumesTransfersTest-1774535415 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:15:27 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3ead9ef3-f3f4-4f44-b903-2c980d00f4d6 tempest-VolumesTransfersTest-1774535415 None] Deleted volume successfully. Jul 03 01:15:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3ead9ef3-f3f4-4f44-b903-2c980d00f4d6 tempest-VolumesTransfersTest-1774535415 None] Lock "cinder-0b44844c-73a2-48af-b97b-832b253d0ff0-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:28 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3da9e370-027d-40de-859a-a3bca00f92cd tempest-GroupSnapshotsTest-1965032115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e" returned: 0 in 0.930s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3da9e370-027d-40de-859a-a3bca00f92cd tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.8acd004d-df87-41b3-94dc-4481c4a67311 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:28 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.8acd004d-df87-41b3-94dc-4481c4a67311 1G Jul 03 01:15:28 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5d0fe42b-04d5-4d48-a80c-131bd2ee21af tempest-TestInstancesWithCinderVolumes-1251159148 None] Acquiring lock "cinder-620574b0-2e40-4fed-b0eb-b6f05b43b214-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5d0fe42b-04d5-4d48-a80c-131bd2ee21af tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "cinder-620574b0-2e40-4fed-b0eb-b6f05b43b214-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5d0fe42b-04d5-4d48-a80c-131bd2ee21af tempest-TestInstancesWithCinderVolumes-1251159148 None] Acquiring lock "cinder-quobyte-620574b0-2e40-4fed-b0eb-b6f05b43b214" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5d0fe42b-04d5-4d48-a80c-131bd2ee21af tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "cinder-quobyte-620574b0-2e40-4fed-b0eb-b6f05b43b214" acquired by "delete_volume" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:28 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e98674-1e8a-4868-a43f-699083c0d103]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d0fe42b-04d5-4d48-a80c-131bd2ee21af tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-620574b0-2e40-4fed-b0eb-b6f05b43b214 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:29 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-620574b0-2e40-4fed-b0eb-b6f05b43b214 Jul 03 01:15:29 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:29 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3da9e370-027d-40de-859a-a3bca00f92cd tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.8acd004d-df87-41b3-94dc-4481c4a67311 1G" returned: 0 in 1.444s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3da9e370-027d-40de-859a-a3bca00f92cd tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fdcb017-d576-487d-a0c4-8500d23df51e -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.8acd004d-df87-41b3-94dc-4481c4a67311 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:29 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fdcb017-d576-487d-a0c4-8500d23df51e -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.8acd004d-df87-41b3-94dc-4481c4a67311 Jul 03 01:15:29 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:30 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d0fe42b-04d5-4d48-a80c-131bd2ee21af tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-620574b0-2e40-4fed-b0eb-b6f05b43b214" returned: 0 in 1.089s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d0fe42b-04d5-4d48-a80c-131bd2ee21af tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-620574b0-2e40-4fed-b0eb-b6f05b43b214 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:30 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-620574b0-2e40-4fed-b0eb-b6f05b43b214 Jul 03 01:15:30 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:30 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3da9e370-027d-40de-859a-a3bca00f92cd tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fdcb017-d576-487d-a0c4-8500d23df51e -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.8acd004d-df87-41b3-94dc-4481c4a67311" returned: 0 in 1.178s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:30 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-3da9e370-027d-40de-859a-a3bca00f92cd tempest-GroupSnapshotsTest-1965032115 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.8acd004d-df87-41b3-94dc-4481c4a67311 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:15:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3da9e370-027d-40de-859a-a3bca00f92cd tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.8acd004d-df87-41b3-94dc-4481c4a67311 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:30 devstack sudo[100076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.8acd004d-df87-41b3-94dc-4481c4a67311 Jul 03 01:15:30 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:31 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d0fe42b-04d5-4d48-a80c-131bd2ee21af tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-620574b0-2e40-4fed-b0eb-b6f05b43b214" returned: 0 in 1.021s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5d0fe42b-04d5-4d48-a80c-131bd2ee21af tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "cinder-quobyte-620574b0-2e40-4fed-b0eb-b6f05b43b214" released by "delete_volume" :: held 2.204s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:31 devstack cinder-volume[86772]: WARNING cinder.quota [None req-5d0fe42b-04d5-4d48-a80c-131bd2ee21af tempest-TestInstancesWithCinderVolumes-1251159148 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1497452791-1308003315 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1497452791-1308003315, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:15:31 devstack cinder-volume[86772]: WARNING cinder.quota [None req-5d0fe42b-04d5-4d48-a80c-131bd2ee21af tempest-TestInstancesWithCinderVolumes-1251159148 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1497452791-1308003315 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1497452791-1308003315, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:15:31 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-5d0fe42b-04d5-4d48-a80c-131bd2ee21af tempest-TestInstancesWithCinderVolumes-1251159148 None] Created reservations ['8c8731a4-6962-4375-9894-0fd1eecbfa1e', '7c3ca1e1-0f00-43ee-8fc4-5ccf8372d778', 'a88d4923-043e-44af-b604-0aa1c197942c', '31ae372c-bb10-422e-9852-35d1f3f76b0a'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:15:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5d0fe42b-04d5-4d48-a80c-131bd2ee21af tempest-TestInstancesWithCinderVolumes-1251159148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5d0fe42b-04d5-4d48-a80c-131bd2ee21af tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5d0fe42b-04d5-4d48-a80c-131bd2ee21af tempest-TestInstancesWithCinderVolumes-1251159148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5d0fe42b-04d5-4d48-a80c-131bd2ee21af tempest-TestInstancesWithCinderVolumes-1251159148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5d0fe42b-04d5-4d48-a80c-131bd2ee21af tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d0fe42b-04d5-4d48-a80c-131bd2ee21af tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:31 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:15:31 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:31 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3da9e370-027d-40de-859a-a3bca00f92cd tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.8acd004d-df87-41b3-94dc-4481c4a67311" returned: 0 in 0.950s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3da9e370-027d-40de-859a-a3bca00f92cd tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:31 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.info Jul 03 01:15:31 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:32 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d0fe42b-04d5-4d48-a80c-131bd2ee21af tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.856s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:32 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-5d0fe42b-04d5-4d48-a80c-131bd2ee21af tempest-TestInstancesWithCinderVolumes-1251159148 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:15:32 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5d0fe42b-04d5-4d48-a80c-131bd2ee21af tempest-TestInstancesWithCinderVolumes-1251159148 None] Deleted volume successfully. Jul 03 01:15:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5d0fe42b-04d5-4d48-a80c-131bd2ee21af tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "cinder-620574b0-2e40-4fed-b0eb-b6f05b43b214-delete_volume" released by "delete_volume" :: held 3.427s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:32 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3da9e370-027d-40de-859a-a3bca00f92cd tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.info" returned: 0 in 0.986s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:32 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-3da9e370-027d-40de-859a-a3bca00f92cd tempest-GroupSnapshotsTest-1965032115 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:15:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3da9e370-027d-40de-859a-a3bca00f92cd tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:32 devstack sudo[100104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.info Jul 03 01:15:32 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:33 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3da9e370-027d-40de-859a-a3bca00f92cd tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.info" returned: 0 in 0.984s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3da9e370-027d-40de-859a-a3bca00f92cd tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.610s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:33 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3da9e370-027d-40de-859a-a3bca00f92cd tempest-GroupSnapshotsTest-1965032115 None] group_snapshot 4e677450-06c6-41e4-89f4-aee47c6b2683: created successfully Jul 03 01:15:34 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-584e6b00-24fd-44c4-b97a-c3fd74e09a82 req-24d4ebf4-410d-4a0b-ab73-23cbb1474c82 tempest-TestInstancesWithCinderVolumes-1251159148 None] Terminate volume connection completed successfully. Jul 03 01:15:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-584e6b00-24fd-44c4-b97a-c3fd74e09a82 req-24d4ebf4-410d-4a0b-ab73-23cbb1474c82 tempest-TestInstancesWithCinderVolumes-1251159148 None] Deleting attachment 6c33dbcf-d054-4cd2-8a7f-df90d08693ce. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:15:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "cinder-quobyte-8acd004d-df87-41b3-94dc-4481c4a67311-18d9865c-4021-4932-a22d-8ce5f06f53b0" by "_create_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-8acd004d-df87-41b3-94dc-4481c4a67311-18d9865c-4021-4932-a22d-8ce5f06f53b0" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Creating volume 18d9865c-4021-4932-a22d-8ce5f06f53b0 from snapshot 8acd004d-df87-41b3-94dc-4481c4a67311 {{(pid=86772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "cinder-quobyte-18d9865c-4021-4932-a22d-8ce5f06f53b0" by "_copy_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-18d9865c-4021-4932-a22d-8ce5f06f53b0" acquired by "_copy_volume_from_snapshot" :: waited 0.050s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] snapshot: 8acd004d-df87-41b3-94dc-4481c4a67311, volume: 18d9865c-4021-4932-a22d-8ce5f06f53b0, {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[16540d47-b7ae-4d84-b794-7fb0c72c533f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.8acd004d-df87-41b3-94dc-4481c4a67311 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:36 devstack sudo[100111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.8acd004d-df87-41b3-94dc-4481c4a67311 Jul 03 01:15:36 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Flow 'volume_create_manager' (a479f5cb-4e05-438d-9051-5f8f80f0cbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d94d93-622e-49d6-b3c3-3da047e6264d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d94d93-622e-49d6-b3c3-3da047e6264d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1481730677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d89f5c2-9743-4527-a08d-2f142737e9d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934976228dba46df81f6fffb0d7d6e03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:36Z,use_quota=True,user_id='da0955d34437420c8bb9a07fb59abc46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db06b55-c8b3-43f1-824a-a9cf4848ddc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db06b55-c8b3-43f1-824a-a9cf4848ddc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f616b0fa-f543-4758-b02f-606f7def05f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG cinder.image.glance [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Creating Keystone auth plugin from conf {{(pid=86772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c130aca0-55ad-41d4-9d8c-31b7f0cacb4a tempest-TestInstancesWithCinderVolumes-1251159148 None] Acquiring lock "cinder-716d9866-9ed6-48da-a674-79333be076df-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c130aca0-55ad-41d4-9d8c-31b7f0cacb4a tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "cinder-716d9866-9ed6-48da-a674-79333be076df-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c130aca0-55ad-41d4-9d8c-31b7f0cacb4a tempest-TestInstancesWithCinderVolumes-1251159148 None] Acquiring lock "cinder-quobyte-716d9866-9ed6-48da-a674-79333be076df" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c130aca0-55ad-41d4-9d8c-31b7f0cacb4a tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "cinder-quobyte-716d9866-9ed6-48da-a674-79333be076df" acquired by "delete_volume" :: waited 0.040s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f616b0fa-f543-4758-b02f-606f7def05f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6d89f5c2-9743-4527-a08d-2f142737e9d6', 'volume_name': 'volume-6d89f5c2-9743-4527-a08d-2f142737e9d6', 'volume_size': 1, 'image_id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d536ca8-2cba-4b44-93ed-ed247e842444', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b88b4a33269476b9f6e11e7fe82fb87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'created_at': datetime.datetime(2026, 7, 2, 22, 56, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 56, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d536ca8-2cba-4b44-93ed-ed247e842444/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47649212-a9e2-40d9-b6e6-99ecc6f418ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47649212-a9e2-40d9-b6e6-99ecc6f418ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (319dd7da-9b25-411d-9e98-9afbf1bac980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:37 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Volume 6d89f5c2-9743-4527-a08d-2f142737e9d6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6d89f5c2-9743-4527-a08d-2f142737e9d6', 'volume_size': 1, 'image_id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d536ca8-2cba-4b44-93ed-ed247e842444', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b88b4a33269476b9f6e11e7fe82fb87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'created_at': datetime.datetime(2026, 7, 2, 22, 56, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 56, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d536ca8-2cba-4b44-93ed-ed247e842444/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 01:15:37 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Trying to clone 6d89f5c2-9743-4527-a08d-2f142737e9d6 from image 3d536ca8-2cba-4b44-93ed-ed247e842444 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3d536ca8-2cba-4b44-93ed-ed247e842444', 'metadata': {}}]). {{(pid=86772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 01:15:37 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9559b7-abea-440c-a130-33f192468b25]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c130aca0-55ad-41d4-9d8c-31b7f0cacb4a tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-716d9866-9ed6-48da-a674-79333be076df {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:37 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-716d9866-9ed6-48da-a674-79333be076df Jul 03 01:15:37 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:37 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.8acd004d-df87-41b3-94dc-4481c4a67311" returned: 0 in 1.275s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fdcb017-d576-487d-a0c4-8500d23df51e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:15:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 01:15:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Creating direct copy from snapshot {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 01:15:37 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30dc0ff-5db1-4c28-9785-8db85b5a3a0b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:37 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_88tvuvgfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 01:15:37 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Image download 20.69 MB at 20.69 MB/s Jul 03 01:15:37 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e Jul 03 01:15:37 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:37 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ba4965-3af1-4b57-b22d-4c08bc6dc496]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_88tvuvgfdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:37 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_88tvuvgfdevstack@QuobyteHD Jul 03 01:15:37 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:38 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c130aca0-55ad-41d4-9d8c-31b7f0cacb4a tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-716d9866-9ed6-48da-a674-79333be076df" returned: 0 in 1.111s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c130aca0-55ad-41d4-9d8c-31b7f0cacb4a tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-716d9866-9ed6-48da-a674-79333be076df {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:38 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-716d9866-9ed6-48da-a674-79333be076df Jul 03 01:15:38 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:38 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e" returned: 0 in 1.263s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:38 devstack cinder-volume[86772]: DEBUG cinder.utils [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Path /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18d9865c-4021-4932-a22d-8ce5f06f53b0 not found in is_blk_device check {{(pid=86772) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 01:15:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18d9865c-4021-4932-a22d-8ce5f06f53b0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:38 devstack sudo[100132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18d9865c-4021-4932-a22d-8ce5f06f53b0 Jul 03 01:15:38 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:39 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_88tvuvgfdevstack@QuobyteHD" returned: 0 in 1.470s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:39 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Temporary image 3d536ca8-2cba-4b44-93ed-ed247e842444 is fetched for user da0955d34437420c8bb9a07fb59abc46. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 01:15:39 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d757c8-2768-4ee6-b6a1-10311f9b5a76]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_88tvuvgfdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:39 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c130aca0-55ad-41d4-9d8c-31b7f0cacb4a tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-716d9866-9ed6-48da-a674-79333be076df" returned: 0 in 1.141s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c130aca0-55ad-41d4-9d8c-31b7f0cacb4a tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "cinder-quobyte-716d9866-9ed6-48da-a674-79333be076df" released by "delete_volume" :: held 2.370s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:39 devstack cinder-volume[86772]: WARNING cinder.quota [None req-c130aca0-55ad-41d4-9d8c-31b7f0cacb4a tempest-TestInstancesWithCinderVolumes-1251159148 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-195502638-345879500 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-195502638-345879500, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:15:39 devstack cinder-volume[86772]: WARNING cinder.quota [None req-c130aca0-55ad-41d4-9d8c-31b7f0cacb4a tempest-TestInstancesWithCinderVolumes-1251159148 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-195502638-345879500 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-195502638-345879500, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:15:39 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-c130aca0-55ad-41d4-9d8c-31b7f0cacb4a tempest-TestInstancesWithCinderVolumes-1251159148 None] Created reservations ['c64024b2-2ce3-4771-8db7-123815b73729', 'bb9e3cef-f78f-4699-b489-448da50f7e68', 'f69c9ffa-59e4-40fe-8b30-7a4f9d1521db', 'df4fae1f-2f4d-426f-92f6-7fc54d575d4b'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:15:39 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_88tvuvgfdevstack@QuobyteHD Jul 03 01:15:39 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c130aca0-55ad-41d4-9d8c-31b7f0cacb4a tempest-TestInstancesWithCinderVolumes-1251159148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c130aca0-55ad-41d4-9d8c-31b7f0cacb4a tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c130aca0-55ad-41d4-9d8c-31b7f0cacb4a tempest-TestInstancesWithCinderVolumes-1251159148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c130aca0-55ad-41d4-9d8c-31b7f0cacb4a tempest-TestInstancesWithCinderVolumes-1251159148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c130aca0-55ad-41d4-9d8c-31b7f0cacb4a tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c130aca0-55ad-41d4-9d8c-31b7f0cacb4a tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:39 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:15:39 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:41 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_88tvuvgfdevstack@QuobyteHD" returned: 0 in 1.897s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:41 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c130aca0-55ad-41d4-9d8c-31b7f0cacb4a tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 2.300s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:41 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-c130aca0-55ad-41d4-9d8c-31b7f0cacb4a tempest-TestInstancesWithCinderVolumes-1251159148 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:15:41 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c130aca0-55ad-41d4-9d8c-31b7f0cacb4a tempest-TestInstancesWithCinderVolumes-1251159148 None] Deleted volume successfully. Jul 03 01:15:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c130aca0-55ad-41d4-9d8c-31b7f0cacb4a tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "cinder-716d9866-9ed6-48da-a674-79333be076df-delete_volume" released by "delete_volume" :: held 5.149s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:46 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18d9865c-4021-4932-a22d-8ce5f06f53b0" returned: 0 in 7.466s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:46 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea76754-7c73-48a3-8189-ca33c0f6db25]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:46 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e Jul 03 01:15:46 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:47 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e" returned: 0 in 1.296s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:47 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Image conversion details: src /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e, size 1024.00 MB, duration 7.47 sec, destination /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18d9865c-4021-4932-a22d-8ce5f06f53b0 {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:15:47 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Converted 1024.00 MB image at 137.14 MB/s Jul 03 01:15:47 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18d9865c-4021-4932-a22d-8ce5f06f53b0 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:15:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18d9865c-4021-4932-a22d-8ce5f06f53b0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:47 devstack sudo[100206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18d9865c-4021-4932-a22d-8ce5f06f53b0 Jul 03 01:15:47 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:47 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-e23e15c5-2fe2-44b5-819d-e55b83aca380 req-1bfa017f-0ca7-4890-a4c0-b254abd9088f tempest-TestInstancesWithCinderVolumes-1251159148 None] Terminate volume connection completed successfully. Jul 03 01:15:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-e23e15c5-2fe2-44b5-819d-e55b83aca380 req-1bfa017f-0ca7-4890-a4c0-b254abd9088f tempest-TestInstancesWithCinderVolumes-1251159148 None] Deleting attachment 77551ce3-390c-44c9-9066-b0ef142acb8c. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:15:48 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18d9865c-4021-4932-a22d-8ce5f06f53b0" returned: 0 in 0.753s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-18d9865c-4021-4932-a22d-8ce5f06f53b0" released by "_copy_volume_from_snapshot" :: held 12.252s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-8acd004d-df87-41b3-94dc-4481c4a67311-18d9865c-4021-4932-a22d-8ce5f06f53b0" released by "_create_volume_from_snapshot" :: held 12.340s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.366s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.120s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1481730677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d89f5c2-9743-4527-a08d-2f142737e9d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934976228dba46df81f6fffb0d7d6e03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:15:36Z,use_quota=True,user_id='da0955d34437420c8bb9a07fb59abc46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:15:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Creating volume 6d89f5c2-9743-4527-a08d-2f142737e9d6 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:15:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:15:48 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:15:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:48 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 1073741824 Jul 03 01:15:48 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:48 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f1118682-9f2c-44f5-b862-5096da8d28d2 tempest-GroupSnapshotsTest-1965032115 None] Create group from source-snapshot-4e677450-06c6-41e4-89f4-aee47c6b2683 completed successfully. Jul 03 01:15:49 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 1073741824" returned: 0 in 1.049s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:49 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 Jul 03 01:15:49 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dab7c6fa-96dc-4dc7-b06c-9b6cae226543 tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "cinder-quobyte-18d9865c-4021-4932-a22d-8ce5f06f53b0" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dab7c6fa-96dc-4dc7-b06c-9b6cae226543 tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-18d9865c-4021-4932-a22d-8ce5f06f53b0" acquired by "delete_volume" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:49 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[23160807-46de-4fd4-93ca-2e20144bf5d8]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dab7c6fa-96dc-4dc7-b06c-9b6cae226543 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18d9865c-4021-4932-a22d-8ce5f06f53b0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:50 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18d9865c-4021-4932-a22d-8ce5f06f53b0 Jul 03 01:15:50 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:50 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6" returned: 0 in 0.821s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] <== create_volume: return (1933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:15:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:50 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Attempting download of 3d536ca8-2cba-4b44-93ed-ed247e842444 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d536ca8-2cba-4b44-93ed-ed247e842444', 'metadata': {}}])) to volume 6d89f5c2-9743-4527-a08d-2f142737e9d6. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 01:15:50 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[292e66ad-ba3e-4312-83a2-10f6e3ae0613]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_jvffd2oq {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:50 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_jvffd2oq Jul 03 01:15:50 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:50 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dab7c6fa-96dc-4dc7-b06c-9b6cae226543 tempest-GroupSnapshotsTest-1965032115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18d9865c-4021-4932-a22d-8ce5f06f53b0" returned: 0 in 1.066s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dab7c6fa-96dc-4dc7-b06c-9b6cae226543 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18d9865c-4021-4932-a22d-8ce5f06f53b0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:50 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18d9865c-4021-4932-a22d-8ce5f06f53b0 Jul 03 01:15:50 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:51 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_jvffd2oq" returned: 0 in 0.953s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_jvffd2oq {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:51 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_jvffd2oq Jul 03 01:15:51 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:51 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dab7c6fa-96dc-4dc7-b06c-9b6cae226543 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18d9865c-4021-4932-a22d-8ce5f06f53b0" returned: 0 in 0.792s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-dab7c6fa-96dc-4dc7-b06c-9b6cae226543 tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-18d9865c-4021-4932-a22d-8ce5f06f53b0" released by "delete_volume" :: held 1.911s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:51 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-dab7c6fa-96dc-4dc7-b06c-9b6cae226543 tempest-GroupSnapshotsTest-1965032115 None] Created reservations ['81d47bdd-26f8-4bba-868f-43f5fe04a139'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:15:51 devstack cinder-volume[86772]: WARNING cinder.quota [None req-dab7c6fa-96dc-4dc7-b06c-9b6cae226543 tempest-GroupSnapshotsTest-1965032115 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1329581319 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1329581319, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:15:51 devstack cinder-volume[86772]: WARNING cinder.quota [None req-dab7c6fa-96dc-4dc7-b06c-9b6cae226543 tempest-GroupSnapshotsTest-1965032115 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1329581319 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1329581319, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:15:51 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-dab7c6fa-96dc-4dc7-b06c-9b6cae226543 tempest-GroupSnapshotsTest-1965032115 None] Created reservations ['5383eaef-7417-45ae-8e48-b14bc2eb2d83', 'a16004e9-d561-4d45-a9a7-ace54dd25ac5', '1f9dc588-c96a-4d08-b1fd-467da1803219', 'a3b156dd-b5c9-4dfa-bb1d-7a8e015c6910'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:15:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6a81e755-1d79-4c82-ba8b-0d03f956bbec tempest-TestInstancesWithCinderVolumes-1251159148 None] Acquiring lock "cinder-633c26e0-badc-4109-b017-b654fa8f1d27-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6a81e755-1d79-4c82-ba8b-0d03f956bbec tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "cinder-633c26e0-badc-4109-b017-b654fa8f1d27-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dab7c6fa-96dc-4dc7-b06c-9b6cae226543 tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dab7c6fa-96dc-4dc7-b06c-9b6cae226543 tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dab7c6fa-96dc-4dc7-b06c-9b6cae226543 tempest-GroupSnapshotsTest-1965032115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-dab7c6fa-96dc-4dc7-b06c-9b6cae226543 tempest-GroupSnapshotsTest-1965032115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-dab7c6fa-96dc-4dc7-b06c-9b6cae226543 tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dab7c6fa-96dc-4dc7-b06c-9b6cae226543 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:52 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:15:52 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6a81e755-1d79-4c82-ba8b-0d03f956bbec tempest-TestInstancesWithCinderVolumes-1251159148 None] Acquiring lock "cinder-quobyte-633c26e0-badc-4109-b017-b654fa8f1d27" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6a81e755-1d79-4c82-ba8b-0d03f956bbec tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "cinder-quobyte-633c26e0-badc-4109-b017-b654fa8f1d27" acquired by "delete_volume" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:52 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_jvffd2oq" returned: 1 in 1.017s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_jvffd2oq' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:15:52 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23111b0-5f90-401a-8536-32a2e7250bb6]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_88tvuvgfdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:52 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d786df-a806-4cfb-97a2-6a0e26b883da]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6a81e755-1d79-4c82-ba8b-0d03f956bbec tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:52 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-04605d81-d59a-4289-a159-d8f82744f9fc tempest-GroupSnapshotsTest-1965032115 None] group_snapshot 4e677450-06c6-41e4-89f4-aee47c6b2683: deleting Jul 03 01:15:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-04605d81-d59a-4289-a159-d8f82744f9fc tempest-GroupSnapshotsTest-1965032115 None] group_snapshot 4e677450-06c6-41e4-89f4-aee47c6b2683: deleting {{(pid=86772) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 01:15:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-04605d81-d59a-4289-a159-d8f82744f9fc tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "cinder-quobyte-8fdcb017-d576-487d-a0c4-8500d23df51e" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-04605d81-d59a-4289-a159-d8f82744f9fc tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-8fdcb017-d576-487d-a0c4-8500d23df51e" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-04605d81-d59a-4289-a159-d8f82744f9fc tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "cinder-quobyte-8acd004d-df87-41b3-94dc-4481c4a67311" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-04605d81-d59a-4289-a159-d8f82744f9fc tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-8acd004d-df87-41b3-94dc-4481c4a67311" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-04605d81-d59a-4289-a159-d8f82744f9fc tempest-GroupSnapshotsTest-1965032115 None] Deleting offline snapshot 8acd004d-df87-41b3-94dc-4481c4a67311 of volume 8fdcb017-d576-487d-a0c4-8500d23df51e {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:15:52 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_88tvuvgfdevstack@QuobyteHD Jul 03 01:15:52 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-04605d81-d59a-4289-a159-d8f82744f9fc tempest-GroupSnapshotsTest-1965032115 None] snapshot_file for this snap is: volume-8fdcb017-d576-487d-a0c4-8500d23df51e.8acd004d-df87-41b3-94dc-4481c4a67311 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:15:52 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[633eca72-6d45-492a-a4e0-78bbce9d6547]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-04605d81-d59a-4289-a159-d8f82744f9fc tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.8acd004d-df87-41b3-94dc-4481c4a67311 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:52 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27 Jul 03 01:15:52 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:52 devstack sudo[100241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.8acd004d-df87-41b3-94dc-4481c4a67311 Jul 03 01:15:52 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:53 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-dab7c6fa-96dc-4dc7-b06c-9b6cae226543 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.960s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:53 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-dab7c6fa-96dc-4dc7-b06c-9b6cae226543 tempest-GroupSnapshotsTest-1965032115 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:15:53 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-dab7c6fa-96dc-4dc7-b06c-9b6cae226543 tempest-GroupSnapshotsTest-1965032115 None] Delete group completed successfully. Jul 03 01:15:53 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_88tvuvgfdevstack@QuobyteHD" returned: 0 in 1.268s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:53 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] 3d536ca8-2cba-4b44-93ed-ed247e842444 was qcow2, converting to raw {{(pid=86772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 01:15:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_88tvuvgfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:53 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_88tvuvgfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 Jul 03 01:15:53 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:53 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6a81e755-1d79-4c82-ba8b-0d03f956bbec tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27" returned: 0 in 1.358s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6a81e755-1d79-4c82-ba8b-0d03f956bbec tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:53 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-04605d81-d59a-4289-a159-d8f82744f9fc tempest-GroupSnapshotsTest-1965032115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.8acd004d-df87-41b3-94dc-4481c4a67311" returned: 0 in 1.210s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-04605d81-d59a-4289-a159-d8f82744f9fc tempest-GroupSnapshotsTest-1965032115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fdcb017-d576-487d-a0c4-8500d23df51e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:15:53 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b9fc5e-38b9-4752-81d5-61fe9279cdba]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-04605d81-d59a-4289-a159-d8f82744f9fc tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:53 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27 Jul 03 01:15:53 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:54 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e Jul 03 01:15:54 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:54 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6a81e755-1d79-4c82-ba8b-0d03f956bbec tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27" returned: 1 in 1.023s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6a81e755-1d79-4c82-ba8b-0d03f956bbec tempest-TestInstancesWithCinderVolumes-1251159148 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:15:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6a81e755-1d79-4c82-ba8b-0d03f956bbec tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:54 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27 Jul 03 01:15:54 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:55 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-04605d81-d59a-4289-a159-d8f82744f9fc tempest-GroupSnapshotsTest-1965032115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e" returned: 0 in 1.093s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-04605d81-d59a-4289-a159-d8f82744f9fc tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.8acd004d-df87-41b3-94dc-4481c4a67311 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:55 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.8acd004d-df87-41b3-94dc-4481c4a67311 Jul 03 01:15:55 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:55 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6a81e755-1d79-4c82-ba8b-0d03f956bbec tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-633c26e0-badc-4109-b017-b654fa8f1d27" returned: 0 in 0.893s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6a81e755-1d79-4c82-ba8b-0d03f956bbec tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "cinder-quobyte-633c26e0-badc-4109-b017-b654fa8f1d27" released by "delete_volume" :: held 3.392s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:55 devstack cinder-volume[86772]: WARNING cinder.quota [None req-6a81e755-1d79-4c82-ba8b-0d03f956bbec tempest-TestInstancesWithCinderVolumes-1251159148 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-700336714-2009547425 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-700336714-2009547425, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:15:55 devstack cinder-volume[86772]: WARNING cinder.quota [None req-6a81e755-1d79-4c82-ba8b-0d03f956bbec tempest-TestInstancesWithCinderVolumes-1251159148 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-700336714-2009547425 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-700336714-2009547425, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:15:55 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-6a81e755-1d79-4c82-ba8b-0d03f956bbec tempest-TestInstancesWithCinderVolumes-1251159148 None] Created reservations ['834c3334-cfdf-4792-8012-b9b222e2a1bb', '110c5ca5-f4d3-455c-868e-3e7fdbdd2475', '374004f9-0bc6-478a-b6c8-a0cbb4a60076', 'bcb28dc2-17b2-4d27-8821-ccfb1c1a6a98'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:15:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6a81e755-1d79-4c82-ba8b-0d03f956bbec tempest-TestInstancesWithCinderVolumes-1251159148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6a81e755-1d79-4c82-ba8b-0d03f956bbec tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6a81e755-1d79-4c82-ba8b-0d03f956bbec tempest-TestInstancesWithCinderVolumes-1251159148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:15:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6a81e755-1d79-4c82-ba8b-0d03f956bbec tempest-TestInstancesWithCinderVolumes-1251159148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:15:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6a81e755-1d79-4c82-ba8b-0d03f956bbec tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:15:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6a81e755-1d79-4c82-ba8b-0d03f956bbec tempest-TestInstancesWithCinderVolumes-1251159148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:55 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:15:55 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:56 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-04605d81-d59a-4289-a159-d8f82744f9fc tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.8acd004d-df87-41b3-94dc-4481c4a67311" returned: 0 in 0.998s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-04605d81-d59a-4289-a159-d8f82744f9fc tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.8acd004d-df87-41b3-94dc-4481c4a67311 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:56 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.8acd004d-df87-41b3-94dc-4481c4a67311 Jul 03 01:15:56 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:56 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_88tvuvgfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6" returned: 0 in 2.457s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:56 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_88tvuvgfdevstack@QuobyteHD, size 112.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:15:56 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Converted 112.00 MB image at 45.52 MB/s Jul 03 01:15:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:56 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 1G Jul 03 01:15:56 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:56 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6a81e755-1d79-4c82-ba8b-0d03f956bbec tempest-TestInstancesWithCinderVolumes-1251159148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.021s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:56 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-6a81e755-1d79-4c82-ba8b-0d03f956bbec tempest-TestInstancesWithCinderVolumes-1251159148 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:15:56 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6a81e755-1d79-4c82-ba8b-0d03f956bbec tempest-TestInstancesWithCinderVolumes-1251159148 None] Deleted volume successfully. Jul 03 01:15:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6a81e755-1d79-4c82-ba8b-0d03f956bbec tempest-TestInstancesWithCinderVolumes-1251159148 None] Lock "cinder-633c26e0-badc-4109-b017-b654fa8f1d27-delete_volume" released by "delete_volume" :: held 4.797s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:57 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-04605d81-d59a-4289-a159-d8f82744f9fc tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e.8acd004d-df87-41b3-94dc-4481c4a67311" returned: 0 in 0.971s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-04605d81-d59a-4289-a159-d8f82744f9fc tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-8acd004d-df87-41b3-94dc-4481c4a67311" released by "_delete_snapshot" :: held 4.423s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-04605d81-d59a-4289-a159-d8f82744f9fc tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-8fdcb017-d576-487d-a0c4-8500d23df51e" released by "delete_snapshot" :: held 4.478s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:15:57 devstack cinder-volume[86772]: WARNING cinder.quota [None req-04605d81-d59a-4289-a159-d8f82744f9fc tempest-GroupSnapshotsTest-1965032115 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1329581319 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1329581319, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:15:57 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-04605d81-d59a-4289-a159-d8f82744f9fc tempest-GroupSnapshotsTest-1965032115 None] Created reservations ['e5f56cc8-2312-48a1-9e59-4bc915e5c7a3', '799f2071-884a-4c53-9554-fadd533c768d', 'd05f1fd2-99a0-413e-816c-978b0d470254', '69da83c7-1bed-473c-8153-25c561789ebd'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:15:57 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 1G" returned: 0 in 1.081s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:57 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f64ebbf-57e1-4c36-bfba-cea79f3c569b]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:57 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-04605d81-d59a-4289-a159-d8f82744f9fc tempest-GroupSnapshotsTest-1965032115 None] group_snapshot 4e677450-06c6-41e4-89f4-aee47c6b2683: deleted successfully Jul 03 01:15:57 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 Jul 03 01:15:57 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:58 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6" returned: 0 in 0.864s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:58 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 Jul 03 01:15:58 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-072b6d40-039e-4597-8a14-64beb0af60f8 tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "cinder-quobyte-8fdcb017-d576-487d-a0c4-8500d23df51e" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:15:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-072b6d40-039e-4597-8a14-64beb0af60f8 tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-8fdcb017-d576-487d-a0c4-8500d23df51e" acquired by "delete_volume" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:15:58 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d026ef96-a849-48ae-816c-d3b742bb4a64]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-072b6d40-039e-4597-8a14-64beb0af60f8 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:58 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e Jul 03 01:15:58 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:59 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6" returned: 1 in 1.032s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:15:59 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Downloaded image 3d536ca8-2cba-4b44-93ed-ed247e842444 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d536ca8-2cba-4b44-93ed-ed247e842444', 'metadata': {}}])) to volume 6d89f5c2-9743-4527-a08d-2f142737e9d6 successfully. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 01:15:59 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Temporary image 3d536ca8-2cba-4b44-93ed-ed247e842444 for user da0955d34437420c8bb9a07fb59abc46 is deleted. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 01:15:59 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Marking volume 6d89f5c2-9743-4527-a08d-2f142737e9d6 as bootable. {{(pid=86772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 01:15:59 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Copying metadata from image 3d536ca8-2cba-4b44-93ed-ed247e842444 to 6d89f5c2-9743-4527-a08d-2f142737e9d6. {{(pid=86772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 01:15:59 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Creating volume glance metadata for volume 6d89f5c2-9743-4527-a08d-2f142737e9d6 backed by image 3d536ca8-2cba-4b44-93ed-ed247e842444 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 01:15:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (319dd7da-9b25-411d-9e98-9afbf1bac980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d89f5c2-9743-4527-a08d-2f142737e9d6', 'volume_size': 1, 'image_id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d536ca8-2cba-4b44-93ed-ed247e842444', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b88b4a33269476b9f6e11e7fe82fb87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'created_at': datetime.datetime(2026, 7, 2, 22, 56, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 56, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d536ca8-2cba-4b44-93ed-ed247e842444/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c76ea859-0da4-4ac9-af5f-aeb0de5fe8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:15:59 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Volume volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 (6d89f5c2-9743-4527-a08d-2f142737e9d6): created successfully Jul 03 01:15:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c76ea859-0da4-4ac9-af5f-aeb0de5fe8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:15:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Flow 'volume_create_manager' (a479f5cb-4e05-438d-9051-5f8f80f0cbbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:15:59 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f6740fa6-8a00-41e1-b39e-676c6b2dc17b tempest-VolumesExtendTest-1345140594 None] Created volume successfully. Jul 03 01:15:59 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Jul 03 01:15:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-072b6d40-039e-4597-8a14-64beb0af60f8 tempest-GroupSnapshotsTest-1965032115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e" returned: 0 in 0.915s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:15:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-072b6d40-039e-4597-8a14-64beb0af60f8 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:15:59 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e Jul 03 01:15:59 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:15:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c78e23a5-2200-46ed-a60d-5c33ab25dffa tempest-VolumesExtendTest-1345140594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:15:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c78e23a5-2200-46ed-a60d-5c33ab25dffa tempest-VolumesExtendTest-1345140594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:15:59 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2b0daf-8228-4bbb-b654-996fcf8f854f]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:15:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c78e23a5-2200-46ed-a60d-5c33ab25dffa tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:00 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 Jul 03 01:16:00 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:00 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-072b6d40-039e-4597-8a14-64beb0af60f8 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-8fdcb017-d576-487d-a0c4-8500d23df51e" returned: 0 in 1.022s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-072b6d40-039e-4597-8a14-64beb0af60f8 tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-8fdcb017-d576-487d-a0c4-8500d23df51e" released by "delete_volume" :: held 2.036s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:16:00 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-072b6d40-039e-4597-8a14-64beb0af60f8 tempest-GroupSnapshotsTest-1965032115 None] Created reservations ['bea93947-36c5-4be6-9e08-d80f02802ed2'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:16:00 devstack cinder-volume[86772]: WARNING cinder.db.api [None req-072b6d40-039e-4597-8a14-64beb0af60f8 tempest-GroupSnapshotsTest-1965032115 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1329581319'] Jul 03 01:16:00 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-072b6d40-039e-4597-8a14-64beb0af60f8 tempest-GroupSnapshotsTest-1965032115 None] Created reservations ['69f2fdb3-a8d7-4d51-8655-953813e134e6', 'a244a022-ca82-43ce-828f-827ad4954728', '624d7685-261e-4f5b-b285-5b082cf023e7', 'b8a73466-1e7d-4265-938c-1b5648e39c62'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:16:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-072b6d40-039e-4597-8a14-64beb0af60f8 tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-072b6d40-039e-4597-8a14-64beb0af60f8 tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-072b6d40-039e-4597-8a14-64beb0af60f8 tempest-GroupSnapshotsTest-1965032115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:16:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-072b6d40-039e-4597-8a14-64beb0af60f8 tempest-GroupSnapshotsTest-1965032115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:16:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-072b6d40-039e-4597-8a14-64beb0af60f8 tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-072b6d40-039e-4597-8a14-64beb0af60f8 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:01 devstack sudo[100313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:16:01 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:01 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c78e23a5-2200-46ed-a60d-5c33ab25dffa tempest-VolumesExtendTest-1345140594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6" returned: 0 in 1.221s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c78e23a5-2200-46ed-a60d-5c33ab25dffa tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:01 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 Jul 03 01:16:01 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-034a32a1-d20a-4342-b92f-900af9d183c9 tempest-GroupSnapshotsTest-1965032115 None] Group tempest-GroupSnapshotsTest-Group-577446021: creating Jul 03 01:16:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-034a32a1-d20a-4342-b92f-900af9d183c9 tempest-GroupSnapshotsTest-1965032115 None] Group tempest-GroupSnapshotsTest-Group-577446021: created successfully Jul 03 01:16:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-034a32a1-d20a-4342-b92f-900af9d183c9 tempest-GroupSnapshotsTest-1965032115 None] Create group completed successfully. Jul 03 01:16:02 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-072b6d40-039e-4597-8a14-64beb0af60f8 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.166s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:02 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-072b6d40-039e-4597-8a14-64beb0af60f8 tempest-GroupSnapshotsTest-1965032115 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:16:02 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-072b6d40-039e-4597-8a14-64beb0af60f8 tempest-GroupSnapshotsTest-1965032115 None] Delete group completed successfully. Jul 03 01:16:02 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c78e23a5-2200-46ed-a60d-5c33ab25dffa tempest-VolumesExtendTest-1345140594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6" returned: 1 in 1.183s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c78e23a5-2200-46ed-a60d-5c33ab25dffa tempest-VolumesExtendTest-1345140594 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:16:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c78e23a5-2200-46ed-a60d-5c33ab25dffa tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 2G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c78e23a5-2200-46ed-a60d-5c33ab25dffa tempest-VolumesExtendTest-1345140594 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 2G" returned: 0 in 0.179s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c78e23a5-2200-46ed-a60d-5c33ab25dffa tempest-VolumesExtendTest-1345140594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.700s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:02 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c78e23a5-2200-46ed-a60d-5c33ab25dffa tempest-VolumesExtendTest-1345140594 None] Extend volume completed successfully. Jul 03 01:16:03 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:16:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Flow 'volume_create_manager' (3d9ff661-4a81-4c45-a94f-f7b89bed4e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb757a0f-2c7e-4d31-98a5-0121498bb89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e6883d10-8de0-4aab-a1ca-ce33323811e9 tempest-VolumesExtendTest-1345140594 None] Acquiring lock "cinder-6d89f5c2-9743-4527-a08d-2f142737e9d6-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:16:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb757a0f-2c7e-4d31-98a5-0121498bb89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1868648837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7fc4d857-7b64-4edc-8c4c-0e3a7fcd7ee9,host='devstack@QuobyteHD#QuobyteHD',id=5299fe5b-a01c-4508-a298-f680de6f5d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b94b8cf214470d8051e79c2d7bd31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:04Z,use_quota=True,user_id='fc5464344d954c808bfe53ee61e72184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04273177-0903-44e9-b50a-9949ef9cefe9),volume_type_id=04273177-0903-44e9-b50a-9949ef9cefe9)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9fba90f-b666-4e22-9b45-31a1274895ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9fba90f-b666-4e22-9b45-31a1274895ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a563098-7579-48dd-839f-bd1ab4dbdb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a563098-7579-48dd-839f-bd1ab4dbdb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5299fe5b-a01c-4508-a298-f680de6f5d94', 'volume_name': 'volume-5299fe5b-a01c-4508-a298-f680de6f5d94', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063191d3-d6ce-4f57-b8a4-09a82d0fb040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063191d3-d6ce-4f57-b8a4-09a82d0fb040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21195166-d6ea-4c25-98e9-377e414409c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:04 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Volume 5299fe5b-a01c-4508-a298-f680de6f5d94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5299fe5b-a01c-4508-a298-f680de6f5d94', 'volume_size': 1} Jul 03 01:16:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7fc4d857-7b64-4edc-8c4c-0e3a7fcd7ee9,created_at=2026-07-02T23:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1868648837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7fc4d857-7b64-4edc-8c4c-0e3a7fcd7ee9,host='devstack@QuobyteHD#QuobyteHD',id=5299fe5b-a01c-4508-a298-f680de6f5d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b94b8cf214470d8051e79c2d7bd31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:04Z,use_quota=True,user_id='fc5464344d954c808bfe53ee61e72184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04273177-0903-44e9-b50a-9949ef9cefe9),volume_type_id=04273177-0903-44e9-b50a-9949ef9cefe9)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:16:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Creating volume 5299fe5b-a01c-4508-a298-f680de6f5d94 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:16:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:16:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:16:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:16:04 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:16:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e6883d10-8de0-4aab-a1ca-ce33323811e9 tempest-VolumesExtendTest-1345140594 None] Lock "cinder-6d89f5c2-9743-4527-a08d-2f142737e9d6-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:16:04 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94 1073741824 Jul 03 01:16:04 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e6883d10-8de0-4aab-a1ca-ce33323811e9 tempest-VolumesExtendTest-1345140594 None] Acquiring lock "cinder-quobyte-6d89f5c2-9743-4527-a08d-2f142737e9d6" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:16:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e6883d10-8de0-4aab-a1ca-ce33323811e9 tempest-VolumesExtendTest-1345140594 None] Lock "cinder-quobyte-6d89f5c2-9743-4527-a08d-2f142737e9d6" acquired by "delete_volume" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:16:04 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fb2ba8-c2ba-460b-a1da-544314793394]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e6883d10-8de0-4aab-a1ca-ce33323811e9 tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:04 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 Jul 03 01:16:04 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:05 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94 1073741824" returned: 0 in 1.260s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:05 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e6883d10-8de0-4aab-a1ca-ce33323811e9 tempest-VolumesExtendTest-1345140594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6" returned: 0 in 1.116s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e6883d10-8de0-4aab-a1ca-ce33323811e9 tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:05 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94 Jul 03 01:16:05 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:05 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 Jul 03 01:16:05 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:06 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94" returned: 0 in 0.793s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] <== create_volume: return (2146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:16:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.148s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21195166-d6ea-4c25-98e9-377e414409c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5299fe5b-a01c-4508-a298-f680de6f5d94', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0edbbf5c-d103-49ab-8444-b216fa55e4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:06 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Volume volume-5299fe5b-a01c-4508-a298-f680de6f5d94 (5299fe5b-a01c-4508-a298-f680de6f5d94): created successfully Jul 03 01:16:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0edbbf5c-d103-49ab-8444-b216fa55e4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Flow 'volume_create_manager' (3d9ff661-4a81-4c45-a94f-f7b89bed4e07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:06 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7dce8564-3467-44d3-b97e-830f52b50d3a tempest-GroupSnapshotsTest-1965032115 None] Created volume successfully. Jul 03 01:16:06 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e6883d10-8de0-4aab-a1ca-ce33323811e9 tempest-VolumesExtendTest-1345140594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6" returned: 1 in 1.068s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e6883d10-8de0-4aab-a1ca-ce33323811e9 tempest-VolumesExtendTest-1345140594 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:16:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e6883d10-8de0-4aab-a1ca-ce33323811e9 tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:06 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6 Jul 03 01:16:06 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Flow 'volume_create_manager' (ea077bb8-bc58-42d7-a422-dd36c6599322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42410940-f433-4b58-85d2-80487cf7c9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42410940-f433-4b58-85d2-80487cf7c9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-227141182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7fc4d857-7b64-4edc-8c4c-0e3a7fcd7ee9,host='devstack@QuobyteHD#QuobyteHD',id=c64b5173-7854-4d8d-8d7b-97bff08e10e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b94b8cf214470d8051e79c2d7bd31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:07Z,use_quota=True,user_id='fc5464344d954c808bfe53ee61e72184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04273177-0903-44e9-b50a-9949ef9cefe9),volume_type_id=04273177-0903-44e9-b50a-9949ef9cefe9)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f494df-0dab-4d5c-a901-6850de1720a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f494df-0dab-4d5c-a901-6850de1720a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eced034c-6124-4a28-b45b-719b011ce96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eced034c-6124-4a28-b45b-719b011ce96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c64b5173-7854-4d8d-8d7b-97bff08e10e5', 'volume_name': 'volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9c4414-be50-42d3-9567-cacff302fff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:07 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9c4414-be50-42d3-9567-cacff302fff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902c8547-9986-4d81-a716-0c7b4aba4ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:07 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Volume c64b5173-7854-4d8d-8d7b-97bff08e10e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5', 'volume_size': 1} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7fc4d857-7b64-4edc-8c4c-0e3a7fcd7ee9,created_at=2026-07-02T23:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-227141182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7fc4d857-7b64-4edc-8c4c-0e3a7fcd7ee9,host='devstack@QuobyteHD#QuobyteHD',id=c64b5173-7854-4d8d-8d7b-97bff08e10e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b94b8cf214470d8051e79c2d7bd31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:07Z,use_quota=True,user_id='fc5464344d954c808bfe53ee61e72184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04273177-0903-44e9-b50a-9949ef9cefe9),volume_type_id=04273177-0903-44e9-b50a-9949ef9cefe9)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Creating volume c64b5173-7854-4d8d-8d7b-97bff08e10e5 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:16:07 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e6883d10-8de0-4aab-a1ca-ce33323811e9 tempest-VolumesExtendTest-1345140594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6d89f5c2-9743-4527-a08d-2f142737e9d6" returned: 0 in 1.149s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e6883d10-8de0-4aab-a1ca-ce33323811e9 tempest-VolumesExtendTest-1345140594 None] Lock "cinder-quobyte-6d89f5c2-9743-4527-a08d-2f142737e9d6" released by "delete_volume" :: held 3.438s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:16:07 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5 1073741824 Jul 03 01:16:07 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e6883d10-8de0-4aab-a1ca-ce33323811e9 tempest-VolumesExtendTest-1345140594 None] Created reservations ['ec37322f-89b0-42e1-aecf-ce3488863e4d', '6d2964d7-0ffd-4163-99dc-4ee40e72e8f9', 'cb1a77c0-f767-4927-81de-cfa54ac5feb3', '4603d085-187e-4ef1-8603-3dfd5a2e73d3'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e6883d10-8de0-4aab-a1ca-ce33323811e9 tempest-VolumesExtendTest-1345140594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e6883d10-8de0-4aab-a1ca-ce33323811e9 tempest-VolumesExtendTest-1345140594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e6883d10-8de0-4aab-a1ca-ce33323811e9 tempest-VolumesExtendTest-1345140594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e6883d10-8de0-4aab-a1ca-ce33323811e9 tempest-VolumesExtendTest-1345140594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e6883d10-8de0-4aab-a1ca-ce33323811e9 tempest-VolumesExtendTest-1345140594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e6883d10-8de0-4aab-a1ca-ce33323811e9 tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:07 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:16:07 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:08 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e6883d10-8de0-4aab-a1ca-ce33323811e9 tempest-VolumesExtendTest-1345140594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.046s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:08 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-e6883d10-8de0-4aab-a1ca-ce33323811e9 tempest-VolumesExtendTest-1345140594 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:16:08 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e6883d10-8de0-4aab-a1ca-ce33323811e9 tempest-VolumesExtendTest-1345140594 None] Deleted volume successfully. Jul 03 01:16:08 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5 1073741824" returned: 0 in 1.314s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e6883d10-8de0-4aab-a1ca-ce33323811e9 tempest-VolumesExtendTest-1345140594 None] Lock "cinder-6d89f5c2-9743-4527-a08d-2f142737e9d6-delete_volume" released by "delete_volume" :: held 4.850s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:16:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:08 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5 Jul 03 01:16:08 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Flow 'volume_create_manager' (5242e497-a3ec-41a5-bfdc-1afb19c7a56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4313ef06-0dda-40ed-9895-f93347b40780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4313ef06-0dda-40ed-9895-f93347b40780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1348408225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18bbaa25-2de2-468b-9ab3-fa212bbff444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934976228dba46df81f6fffb0d7d6e03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:09Z,use_quota=True,user_id='da0955d34437420c8bb9a07fb59abc46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd89ed27-146d-4067-9dd1-d69fcc99da8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd89ed27-146d-4067-9dd1-d69fcc99da8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2cab2a-c7af-4f6b-94e5-51b39f955803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2cab2a-c7af-4f6b-94e5-51b39f955803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18bbaa25-2de2-468b-9ab3-fa212bbff444', 'volume_name': 'volume-18bbaa25-2de2-468b-9ab3-fa212bbff444', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf56a66-8bd3-4596-88f7-80dfdf363771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf56a66-8bd3-4596-88f7-80dfdf363771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e42f5b51-b497-4f0e-a7c5-ed81d810f83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:09 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Volume 18bbaa25-2de2-468b-9ab3-fa212bbff444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18bbaa25-2de2-468b-9ab3-fa212bbff444', 'volume_size': 1} Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:09 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5" returned: 0 in 0.960s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] <== create_volume: return (2347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.349s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.266s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1348408225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18bbaa25-2de2-468b-9ab3-fa212bbff444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934976228dba46df81f6fffb0d7d6e03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:09Z,use_quota=True,user_id='da0955d34437420c8bb9a07fb59abc46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Creating volume 18bbaa25-2de2-468b-9ab3-fa212bbff444 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:16:09 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902c8547-9986-4d81-a716-0c7b4aba4ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b3738ba-010c-44e4-a8fe-36312866bd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:09 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444 1073741824 Jul 03 01:16:09 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:09 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Volume volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5 (c64b5173-7854-4d8d-8d7b-97bff08e10e5): created successfully Jul 03 01:16:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b3738ba-010c-44e4-a8fe-36312866bd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Flow 'volume_create_manager' (ea077bb8-bc58-42d7-a422-dd36c6599322) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:10 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-36e82ac1-52e6-49d4-8c98-d5b621b9902e tempest-GroupSnapshotsTest-1965032115 None] Created volume successfully. Jul 03 01:16:11 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444 1073741824" returned: 0 in 1.244s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:11 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444 Jul 03 01:16:11 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:11 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8063bc45-dc96-49e7-9810-5db035db92bd tempest-GroupSnapshotsTest-1965032115 None] Update group completed successfully. Jul 03 01:16:12 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444" returned: 0 in 0.967s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] <== create_volume: return (2301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:16:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.304s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e42f5b51-b497-4f0e-a7c5-ed81d810f83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18bbaa25-2de2-468b-9ab3-fa212bbff444', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (206a57fe-14db-4de1-92f5-d3b0926e8f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:12 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Volume volume-18bbaa25-2de2-468b-9ab3-fa212bbff444 (18bbaa25-2de2-468b-9ab3-fa212bbff444): created successfully Jul 03 01:16:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (206a57fe-14db-4de1-92f5-d3b0926e8f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Flow 'volume_create_manager' (5242e497-a3ec-41a5-bfdc-1afb19c7a56e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:12 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-162dbbb4-8262-4a7e-b094-516e97578aef tempest-VolumesExtendTest-1345140594 None] Created volume successfully. Jul 03 01:16:12 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-589935cc-c4a1-4866-b6fa-e735bee456ab tempest-GroupSnapshotsTest-1965032115 None] Update group completed successfully. Jul 03 01:16:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:16:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:16:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:16:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:12 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:16:12 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Flow 'volume_create_manager' (31743091-a487-4d2a-a11b-858a7c02ea0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02761379-2ade-46af-8d44-27ab9311b7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02761379-2ade-46af-8d44-27ab9311b7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1840066853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b33ca7e9-2e23-4841-9604-9a38551a8f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='580c7bcfb871437cbab178bfca0de640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:13Z,use_quota=True,user_id='c5b93179d59b46c88701ea2b9aa7b049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15245e4-8b6c-4256-b6fb-a71f01e0b86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15245e4-8b6c-4256-b6fb-a71f01e0b86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef076c1a-c640-4246-891d-936ba23a5970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef076c1a-c640-4246-891d-936ba23a5970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b33ca7e9-2e23-4841-9604-9a38551a8f51', 'volume_name': 'volume-b33ca7e9-2e23-4841-9604-9a38551a8f51', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b8391f2-e282-4ac8-9cb2-eea237593985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b8391f2-e282-4ac8-9cb2-eea237593985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa4c02c-d9e5-4f9e-9c64-e6f9afcb92ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:13 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Volume b33ca7e9-2e23-4841-9604-9a38551a8f51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b33ca7e9-2e23-4841-9604-9a38551a8f51', 'volume_size': 1} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1840066853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b33ca7e9-2e23-4841-9604-9a38551a8f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='580c7bcfb871437cbab178bfca0de640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:13Z,use_quota=True,user_id='c5b93179d59b46c88701ea2b9aa7b049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Creating volume b33ca7e9-2e23-4841-9604-9a38551a8f51 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:16:13 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33ca7e9-2e23-4841-9604-9a38551a8f51 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:13 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33ca7e9-2e23-4841-9604-9a38551a8f51 1073741824 Jul 03 01:16:13 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-342aaf2b-b1f3-4754-ad60-e6dde3232b5c tempest-VolumesExtendTest-1345140594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Flow 'volume_create_manager' (69288a5f-87e6-46e2-a996-28525e46f1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90b44f8-9a20-45ec-b2f6-36515f5abe16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90b44f8-9a20-45ec-b2f6-36515f5abe16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1051489354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4430a11b-8c74-4549-a4b2-f47a22ca3434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='580c7bcfb871437cbab178bfca0de640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:14Z,use_quota=True,user_id='c5b93179d59b46c88701ea2b9aa7b049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a47d1faa-835d-4e8d-a695-caf3a68732ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a47d1faa-835d-4e8d-a695-caf3a68732ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ced34e0-11ad-4e75-a17f-e85b60712918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ced34e0-11ad-4e75-a17f-e85b60712918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4430a11b-8c74-4549-a4b2-f47a22ca3434', 'volume_name': 'volume-4430a11b-8c74-4549-a4b2-f47a22ca3434', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b87e2b2-1923-46fc-8022-b6004ce1f9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b87e2b2-1923-46fc-8022-b6004ce1f9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091f0eeb-32b7-4a9e-af34-eb4778ef39ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:13 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Volume 4430a11b-8c74-4549-a4b2-f47a22ca3434: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4430a11b-8c74-4549-a4b2-f47a22ca3434', 'volume_size': 1} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:13 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.055s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:16:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:16:14 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-69c66208-176c-4265-a497-6b1979c992da tempest-GroupSnapshotsTest-1965032115 None] Update group completed successfully. Jul 03 01:16:14 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33ca7e9-2e23-4841-9604-9a38551a8f51 1073741824" returned: 0 in 1.412s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33ca7e9-2e23-4841-9604-9a38551a8f51 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:14 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33ca7e9-2e23-4841-9604-9a38551a8f51 Jul 03 01:16:14 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:15 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=111,cinder:DELETE=8,cinder:SELECT=116,cinder:INSERT=26 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:16:15 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=98,cinder:INSERT=33,cinder:UPDATE=110,cinder:DELETE=5 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:16:15 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-21c6b769-1109-4d4a-a081-422e6b4b7339 tempest-GroupSnapshotsTest-1965032115 None] Update group completed successfully. Jul 03 01:16:15 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33ca7e9-2e23-4841-9604-9a38551a8f51" returned: 0 in 0.881s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] <== create_volume: return (2345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:16:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.349s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-342aaf2b-b1f3-4754-ad60-e6dde3232b5c tempest-VolumesExtendTest-1345140594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.262s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-342aaf2b-b1f3-4754-ad60-e6dde3232b5c tempest-VolumesExtendTest-1345140594 None] Creating offline snapshot 72d39633-7474-4c60-a899-60e82ce713c5 of volume 18bbaa25-2de2-468b-9ab3-fa212bbff444 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:16:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa4c02c-d9e5-4f9e-9c64-e6f9afcb92ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b33ca7e9-2e23-4841-9604-9a38551a8f51', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3559c660-f033-4121-819e-0bf01f0e94fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:15 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3ea494-7a65-4c38-83b0-503d18017681]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-342aaf2b-b1f3-4754-ad60-e6dde3232b5c tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:15 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Volume volume-b33ca7e9-2e23-4841-9604-9a38551a8f51 (b33ca7e9-2e23-4841-9604-9a38551a8f51): created successfully Jul 03 01:16:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3559c660-f033-4121-819e-0bf01f0e94fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Flow 'volume_create_manager' (31743091-a487-4d2a-a11b-858a7c02ea0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:15 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-56be634f-6b45-419d-9950-1a6e792649a0 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Created volume successfully. Jul 03 01:16:15 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444 Jul 03 01:16:15 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:16 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-342aaf2b-b1f3-4754-ad60-e6dde3232b5c tempest-VolumesExtendTest-1345140594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444" returned: 0 in 0.874s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-342aaf2b-b1f3-4754-ad60-e6dde3232b5c tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.72d39633-7474-4c60-a899-60e82ce713c5 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:16 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.72d39633-7474-4c60-a899-60e82ce713c5 1G Jul 03 01:16:16 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:17 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] GroupSnapshot 3b6273c8-fa1f-4db1-b2dc-59bd2b1fcbc5: creating. Jul 03 01:16:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] Group snapshot 3b6273c8-fa1f-4db1-b2dc-59bd2b1fcbc5: creating. {{(pid=86772) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 01:16:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:17 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-342aaf2b-b1f3-4754-ad60-e6dde3232b5c tempest-VolumesExtendTest-1345140594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.72d39633-7474-4c60-a899-60e82ce713c5 1G" returned: 0 in 1.045s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-342aaf2b-b1f3-4754-ad60-e6dde3232b5c tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18bbaa25-2de2-468b-9ab3-fa212bbff444 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.72d39633-7474-4c60-a899-60e82ce713c5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:17 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18bbaa25-2de2-468b-9ab3-fa212bbff444 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.72d39633-7474-4c60-a899-60e82ce713c5 Jul 03 01:16:17 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:18 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-342aaf2b-b1f3-4754-ad60-e6dde3232b5c tempest-VolumesExtendTest-1345140594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18bbaa25-2de2-468b-9ab3-fa212bbff444 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.72d39633-7474-4c60-a899-60e82ce713c5" returned: 0 in 0.925s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:18 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-342aaf2b-b1f3-4754-ad60-e6dde3232b5c tempest-VolumesExtendTest-1345140594 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.72d39633-7474-4c60-a899-60e82ce713c5 is being set with open permissions: ugo+rw Jul 03 01:16:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-342aaf2b-b1f3-4754-ad60-e6dde3232b5c tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.72d39633-7474-4c60-a899-60e82ce713c5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:18 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.72d39633-7474-4c60-a899-60e82ce713c5 Jul 03 01:16:18 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:19 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-342aaf2b-b1f3-4754-ad60-e6dde3232b5c tempest-VolumesExtendTest-1345140594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.72d39633-7474-4c60-a899-60e82ce713c5" returned: 0 in 0.782s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-342aaf2b-b1f3-4754-ad60-e6dde3232b5c tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:19 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.info Jul 03 01:16:19 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:19 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-342aaf2b-b1f3-4754-ad60-e6dde3232b5c tempest-VolumesExtendTest-1345140594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.info" returned: 0 in 0.699s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:19 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-342aaf2b-b1f3-4754-ad60-e6dde3232b5c tempest-VolumesExtendTest-1345140594 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.info is being set with open permissions: ugo+rw Jul 03 01:16:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-342aaf2b-b1f3-4754-ad60-e6dde3232b5c tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:19 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.info Jul 03 01:16:19 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:20 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-342aaf2b-b1f3-4754-ad60-e6dde3232b5c tempest-VolumesExtendTest-1345140594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.info" returned: 0 in 0.809s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-342aaf2b-b1f3-4754-ad60-e6dde3232b5c tempest-VolumesExtendTest-1345140594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.263s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.054s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1051489354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4430a11b-8c74-4549-a4b2-f47a22ca3434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='580c7bcfb871437cbab178bfca0de640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:14Z,use_quota=True,user_id='c5b93179d59b46c88701ea2b9aa7b049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:16:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Creating volume 4430a11b-8c74-4549-a4b2-f47a22ca3434 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:16:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:16:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:16:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:16:20 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:16:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4430a11b-8c74-4549-a4b2-f47a22ca3434 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:20 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4430a11b-8c74-4549-a4b2-f47a22ca3434 1073741824 Jul 03 01:16:20 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:20 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-342aaf2b-b1f3-4754-ad60-e6dde3232b5c tempest-VolumesExtendTest-1345140594 None] Create snapshot completed successfully Jul 03 01:16:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fe4ed656-aa20-4a4d-981d-89347e1b97f7 tempest-VolumesExtendTest-1345140594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:21 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4430a11b-8c74-4549-a4b2-f47a22ca3434 1073741824" returned: 0 in 1.102s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4430a11b-8c74-4549-a4b2-f47a22ca3434 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:21 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4430a11b-8c74-4549-a4b2-f47a22ca3434 Jul 03 01:16:21 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:22 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4430a11b-8c74-4549-a4b2-f47a22ca3434" returned: 0 in 0.801s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:16:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.643s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] Creating offline snapshot 48b827b9-5af3-428d-9ae5-96fe14817009 of volume c64b5173-7854-4d8d-8d7b-97bff08e10e5 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:16:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091f0eeb-32b7-4a9e-af34-eb4778ef39ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4430a11b-8c74-4549-a4b2-f47a22ca3434', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff28f4a6-c0bc-4ada-9d1e-32342422f8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:22 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9588a1cd-5a02-42e7-9146-c5e0680c1550]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:22 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Volume volume-4430a11b-8c74-4549-a4b2-f47a22ca3434 (4430a11b-8c74-4549-a4b2-f47a22ca3434): created successfully Jul 03 01:16:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff28f4a6-c0bc-4ada-9d1e-32342422f8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Flow 'volume_create_manager' (69288a5f-87e6-46e2-a996-28525e46f1c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:22 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c46f330b-f24f-476d-ac8d-c4fe91906613 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Created volume successfully. Jul 03 01:16:22 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5 Jul 03 01:16:22 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:23 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5" returned: 0 in 0.944s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.48b827b9-5af3-428d-9ae5-96fe14817009 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:23 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.48b827b9-5af3-428d-9ae5-96fe14817009 1G Jul 03 01:16:23 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:24 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.48b827b9-5af3-428d-9ae5-96fe14817009 1G" returned: 0 in 1.096s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.48b827b9-5af3-428d-9ae5-96fe14817009 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:24 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.48b827b9-5af3-428d-9ae5-96fe14817009 Jul 03 01:16:24 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:25 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.48b827b9-5af3-428d-9ae5-96fe14817009" returned: 0 in 1.088s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:25 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.48b827b9-5af3-428d-9ae5-96fe14817009 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:16:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.48b827b9-5af3-428d-9ae5-96fe14817009 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:25 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.48b827b9-5af3-428d-9ae5-96fe14817009 Jul 03 01:16:25 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:26 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.48b827b9-5af3-428d-9ae5-96fe14817009" returned: 0 in 0.768s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:26 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.info Jul 03 01:16:26 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:27 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.info" returned: 0 in 0.755s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:27 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:16:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:27 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.info Jul 03 01:16:27 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:28 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.info" returned: 0 in 0.714s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.487s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] Creating offline snapshot 870b1056-21ca-4298-b7ab-0f8f84dbb3b2 of volume 5299fe5b-a01c-4508-a298-f680de6f5d94 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:16:28 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[66142e60-bb4b-441e-8f02-1de260a791ad]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:28 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94 Jul 03 01:16:28 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:29 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94" returned: 0 in 0.856s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94.870b1056-21ca-4298-b7ab-0f8f84dbb3b2 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:29 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94.870b1056-21ca-4298-b7ab-0f8f84dbb3b2 1G Jul 03 01:16:29 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:30 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94.870b1056-21ca-4298-b7ab-0f8f84dbb3b2 1G" returned: 0 in 0.987s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5299fe5b-a01c-4508-a298-f680de6f5d94 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94.870b1056-21ca-4298-b7ab-0f8f84dbb3b2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:30 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5299fe5b-a01c-4508-a298-f680de6f5d94 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94.870b1056-21ca-4298-b7ab-0f8f84dbb3b2 Jul 03 01:16:30 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:30 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5299fe5b-a01c-4508-a298-f680de6f5d94 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94.870b1056-21ca-4298-b7ab-0f8f84dbb3b2" returned: 0 in 0.765s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:30 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94.870b1056-21ca-4298-b7ab-0f8f84dbb3b2 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:16:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94.870b1056-21ca-4298-b7ab-0f8f84dbb3b2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:30 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94.870b1056-21ca-4298-b7ab-0f8f84dbb3b2 Jul 03 01:16:30 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:31 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94.870b1056-21ca-4298-b7ab-0f8f84dbb3b2" returned: 0 in 0.887s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:31 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94.info Jul 03 01:16:31 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:32 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94.info" returned: 0 in 0.743s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:32 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:16:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:32 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94.info Jul 03 01:16:32 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:33 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94.info" returned: 0 in 1.085s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.438s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fe4ed656-aa20-4a4d-981d-89347e1b97f7 tempest-VolumesExtendTest-1345140594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 11.871s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:33 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a559d4-95f6-4abe-846e-48d48389d5b8]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fe4ed656-aa20-4a4d-981d-89347e1b97f7 tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:33 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444 Jul 03 01:16:33 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:33 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1ac8dbca-3fa3-485b-9f99-0089688b98d1 tempest-GroupSnapshotsTest-1965032115 None] group_snapshot 3b6273c8-fa1f-4db1-b2dc-59bd2b1fcbc5: created successfully Jul 03 01:16:34 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] group_snapshot 3b6273c8-fa1f-4db1-b2dc-59bd2b1fcbc5: deleting Jul 03 01:16:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] group_snapshot 3b6273c8-fa1f-4db1-b2dc-59bd2b1fcbc5: deleting {{(pid=86772) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 01:16:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "cinder-quobyte-c64b5173-7854-4d8d-8d7b-97bff08e10e5" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:16:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-c64b5173-7854-4d8d-8d7b-97bff08e10e5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:16:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "cinder-quobyte-48b827b9-5af3-428d-9ae5-96fe14817009" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:16:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-48b827b9-5af3-428d-9ae5-96fe14817009" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:16:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Deleting offline snapshot 48b827b9-5af3-428d-9ae5-96fe14817009 of volume c64b5173-7854-4d8d-8d7b-97bff08e10e5 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:16:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] snapshot_file for this snap is: volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.48b827b9-5af3-428d-9ae5-96fe14817009 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:16:34 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c839f1f7-e3d7-4b9c-8d77-b6c5863609f0]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.48b827b9-5af3-428d-9ae5-96fe14817009 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:34 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.48b827b9-5af3-428d-9ae5-96fe14817009 Jul 03 01:16:34 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:35 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fe4ed656-aa20-4a4d-981d-89347e1b97f7 tempest-VolumesExtendTest-1345140594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444" returned: 0 in 1.509s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fe4ed656-aa20-4a4d-981d-89347e1b97f7 tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.72d39633-7474-4c60-a899-60e82ce713c5 2G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fe4ed656-aa20-4a4d-981d-89347e1b97f7 tempest-VolumesExtendTest-1345140594 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.72d39633-7474-4c60-a899-60e82ce713c5 2G" returned: 0 in 0.258s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fe4ed656-aa20-4a4d-981d-89347e1b97f7 tempest-VolumesExtendTest-1345140594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.874s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:35 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-fe4ed656-aa20-4a4d-981d-89347e1b97f7 tempest-VolumesExtendTest-1345140594 None] Extend volume completed successfully. Jul 03 01:16:36 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.48b827b9-5af3-428d-9ae5-96fe14817009" returned: 0 in 1.402s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:16:36 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44697df-6a58-40a3-a881-c856aa1f8eb6]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:36 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5 Jul 03 01:16:36 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7eab6e71-13ed-43d9-bbcf-76c8d799093d tempest-VolumesExtendTest-1345140594 None] Acquiring lock "cinder-72d39633-7474-4c60-a899-60e82ce713c5-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:16:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7eab6e71-13ed-43d9-bbcf-76c8d799093d tempest-VolumesExtendTest-1345140594 None] Lock "cinder-72d39633-7474-4c60-a899-60e82ce713c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:16:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7eab6e71-13ed-43d9-bbcf-76c8d799093d tempest-VolumesExtendTest-1345140594 None] Acquiring lock "cinder-quobyte-18bbaa25-2de2-468b-9ab3-fa212bbff444" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:16:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7eab6e71-13ed-43d9-bbcf-76c8d799093d tempest-VolumesExtendTest-1345140594 None] Lock "cinder-quobyte-18bbaa25-2de2-468b-9ab3-fa212bbff444" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:16:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7eab6e71-13ed-43d9-bbcf-76c8d799093d tempest-VolumesExtendTest-1345140594 None] Acquiring lock "cinder-quobyte-72d39633-7474-4c60-a899-60e82ce713c5" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:16:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7eab6e71-13ed-43d9-bbcf-76c8d799093d tempest-VolumesExtendTest-1345140594 None] Lock "cinder-quobyte-72d39633-7474-4c60-a899-60e82ce713c5" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:16:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7eab6e71-13ed-43d9-bbcf-76c8d799093d tempest-VolumesExtendTest-1345140594 None] Deleting offline snapshot 72d39633-7474-4c60-a899-60e82ce713c5 of volume 18bbaa25-2de2-468b-9ab3-fa212bbff444 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:16:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7eab6e71-13ed-43d9-bbcf-76c8d799093d tempest-VolumesExtendTest-1345140594 None] snapshot_file for this snap is: volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.72d39633-7474-4c60-a899-60e82ce713c5 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:16:36 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[60edd362-b711-4a25-8cf4-ed89ffd95993]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7eab6e71-13ed-43d9-bbcf-76c8d799093d tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.72d39633-7474-4c60-a899-60e82ce713c5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:36 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.72d39633-7474-4c60-a899-60e82ce713c5 Jul 03 01:16:36 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:37 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5" returned: 0 in 1.400s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.48b827b9-5af3-428d-9ae5-96fe14817009 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:37 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.48b827b9-5af3-428d-9ae5-96fe14817009 Jul 03 01:16:37 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:38 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7eab6e71-13ed-43d9-bbcf-76c8d799093d tempest-VolumesExtendTest-1345140594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.72d39633-7474-4c60-a899-60e82ce713c5" returned: 0 in 1.616s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7eab6e71-13ed-43d9-bbcf-76c8d799093d tempest-VolumesExtendTest-1345140594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18bbaa25-2de2-468b-9ab3-fa212bbff444(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:16:38 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c139721-4477-422d-843f-d4494f5762e8]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7eab6e71-13ed-43d9-bbcf-76c8d799093d tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:38 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444 Jul 03 01:16:38 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:39 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.48b827b9-5af3-428d-9ae5-96fe14817009" returned: 0 in 1.468s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.48b827b9-5af3-428d-9ae5-96fe14817009 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:39 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.48b827b9-5af3-428d-9ae5-96fe14817009 Jul 03 01:16:39 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:40 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7eab6e71-13ed-43d9-bbcf-76c8d799093d tempest-VolumesExtendTest-1345140594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444" returned: 0 in 1.744s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7eab6e71-13ed-43d9-bbcf-76c8d799093d tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.72d39633-7474-4c60-a899-60e82ce713c5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:40 devstack sudo[100648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.72d39633-7474-4c60-a899-60e82ce713c5 Jul 03 01:16:40 devstack sudo[100648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:40 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5.48b827b9-5af3-428d-9ae5-96fe14817009" returned: 0 in 1.174s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-48b827b9-5af3-428d-9ae5-96fe14817009" released by "_delete_snapshot" :: held 5.694s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:16:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-c64b5173-7854-4d8d-8d7b-97bff08e10e5" released by "delete_snapshot" :: held 5.738s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:16:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "cinder-quobyte-5299fe5b-a01c-4508-a298-f680de6f5d94" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:16:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-5299fe5b-a01c-4508-a298-f680de6f5d94" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:16:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "cinder-quobyte-870b1056-21ca-4298-b7ab-0f8f84dbb3b2" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:16:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-870b1056-21ca-4298-b7ab-0f8f84dbb3b2" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:16:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Deleting offline snapshot 870b1056-21ca-4298-b7ab-0f8f84dbb3b2 of volume 5299fe5b-a01c-4508-a298-f680de6f5d94 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:16:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] snapshot_file for this snap is: volume-5299fe5b-a01c-4508-a298-f680de6f5d94.870b1056-21ca-4298-b7ab-0f8f84dbb3b2 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:16:40 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc3b8b8-4d9e-4168-9389-c504c9542d8b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94.870b1056-21ca-4298-b7ab-0f8f84dbb3b2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:40 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94.870b1056-21ca-4298-b7ab-0f8f84dbb3b2 Jul 03 01:16:40 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:41 devstack sudo[100648]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7eab6e71-13ed-43d9-bbcf-76c8d799093d tempest-VolumesExtendTest-1345140594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.72d39633-7474-4c60-a899-60e82ce713c5" returned: 0 in 1.130s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7eab6e71-13ed-43d9-bbcf-76c8d799093d tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.72d39633-7474-4c60-a899-60e82ce713c5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:41 devstack sudo[100655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.72d39633-7474-4c60-a899-60e82ce713c5 Jul 03 01:16:41 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:41 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94.870b1056-21ca-4298-b7ab-0f8f84dbb3b2" returned: 0 in 1.153s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5299fe5b-a01c-4508-a298-f680de6f5d94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:16:41 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efbf706-2551-48e8-8830-da617b886ac4]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:41 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94 Jul 03 01:16:41 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:42 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7eab6e71-13ed-43d9-bbcf-76c8d799093d tempest-VolumesExtendTest-1345140594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444.72d39633-7474-4c60-a899-60e82ce713c5" returned: 0 in 1.029s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7eab6e71-13ed-43d9-bbcf-76c8d799093d tempest-VolumesExtendTest-1345140594 None] Lock "cinder-quobyte-72d39633-7474-4c60-a899-60e82ce713c5" released by "_delete_snapshot" :: held 5.711s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:16:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7eab6e71-13ed-43d9-bbcf-76c8d799093d tempest-VolumesExtendTest-1345140594 None] Lock "cinder-quobyte-18bbaa25-2de2-468b-9ab3-fa212bbff444" released by "delete_snapshot" :: held 5.767s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:16:42 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-7eab6e71-13ed-43d9-bbcf-76c8d799093d tempest-VolumesExtendTest-1345140594 None] Created reservations ['cc218de4-9416-4825-a3e5-6febe62f589d', '8d13274e-b283-4dfe-b726-919dbe2394bc', '03fdefa9-12bd-4ada-8a94-5b0bcf7ffd7a', '9d07b64f-3a66-4c57-8670-c09fa9c9e936'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:16:42 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7eab6e71-13ed-43d9-bbcf-76c8d799093d tempest-VolumesExtendTest-1345140594 None] Delete snapshot completed successfully. Jul 03 01:16:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7eab6e71-13ed-43d9-bbcf-76c8d799093d tempest-VolumesExtendTest-1345140594 None] Lock "cinder-72d39633-7474-4c60-a899-60e82ce713c5-delete_snapshot" released by "delete_snapshot" :: held 5.967s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:16:42 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94" returned: 0 in 0.903s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94.870b1056-21ca-4298-b7ab-0f8f84dbb3b2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:42 devstack sudo[100667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94.870b1056-21ca-4298-b7ab-0f8f84dbb3b2 Jul 03 01:16:42 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-995e10f7-d6ec-4320-8c19-980305730b90 tempest-VolumesExtendTest-1345140594 None] Acquiring lock "cinder-18bbaa25-2de2-468b-9ab3-fa212bbff444-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:16:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-995e10f7-d6ec-4320-8c19-980305730b90 tempest-VolumesExtendTest-1345140594 None] Lock "cinder-18bbaa25-2de2-468b-9ab3-fa212bbff444-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:16:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-995e10f7-d6ec-4320-8c19-980305730b90 tempest-VolumesExtendTest-1345140594 None] Acquiring lock "cinder-quobyte-18bbaa25-2de2-468b-9ab3-fa212bbff444" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:16:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-995e10f7-d6ec-4320-8c19-980305730b90 tempest-VolumesExtendTest-1345140594 None] Lock "cinder-quobyte-18bbaa25-2de2-468b-9ab3-fa212bbff444" acquired by "delete_volume" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:16:43 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e370f4-1a27-4ca3-bc60-868330783078]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-995e10f7-d6ec-4320-8c19-980305730b90 tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:43 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94.870b1056-21ca-4298-b7ab-0f8f84dbb3b2" returned: 0 in 0.990s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94.870b1056-21ca-4298-b7ab-0f8f84dbb3b2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:43 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444 Jul 03 01:16:43 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:43 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94.870b1056-21ca-4298-b7ab-0f8f84dbb3b2 Jul 03 01:16:43 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:44 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-995e10f7-d6ec-4320-8c19-980305730b90 tempest-VolumesExtendTest-1345140594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444" returned: 0 in 0.985s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-995e10f7-d6ec-4320-8c19-980305730b90 tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:44 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:44 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444 Jul 03 01:16:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94.870b1056-21ca-4298-b7ab-0f8f84dbb3b2" returned: 0 in 0.882s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:44 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-870b1056-21ca-4298-b7ab-0f8f84dbb3b2" released by "_delete_snapshot" :: held 4.056s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:16:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-5299fe5b-a01c-4508-a298-f680de6f5d94" released by "delete_snapshot" :: held 4.093s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:16:44 devstack cinder-volume[86772]: WARNING cinder.quota [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1533549734 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1533549734, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:16:44 devstack cinder-volume[86772]: WARNING cinder.quota [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1533549734 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1533549734, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:16:44 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Created reservations ['e67c9c52-98bd-4da1-8e5f-37c89ce59042', '6a00c054-3e84-4bca-b882-64c2d02a49ae', '9edd1d18-8cdd-45f1-b40d-57a21d3fec17', 'c81bbba1-f6ed-4451-ba2a-2a78d3e01b7f'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:16:44 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] Created reservations ['4fc705a8-ef25-41a8-b6a2-277953d6c14f', '9b0a5182-917a-4c28-a8d6-a50fa9de361a', 'c88cd8e3-696a-4ccc-af7f-ce9e84fa5f1d', '8051c0b6-73b9-4ddc-9b80-eb4db455ac18'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:16:44 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6017826e-6a57-4b72-a40d-5b62cd7933a7 tempest-GroupSnapshotsTest-1965032115 None] group_snapshot 3b6273c8-fa1f-4db1-b2dc-59bd2b1fcbc5: deleted successfully Jul 03 01:16:45 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-995e10f7-d6ec-4320-8c19-980305730b90 tempest-VolumesExtendTest-1345140594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-18bbaa25-2de2-468b-9ab3-fa212bbff444" returned: 0 in 0.720s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-995e10f7-d6ec-4320-8c19-980305730b90 tempest-VolumesExtendTest-1345140594 None] Lock "cinder-quobyte-18bbaa25-2de2-468b-9ab3-fa212bbff444" released by "delete_volume" :: held 1.814s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:16:45 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-995e10f7-d6ec-4320-8c19-980305730b90 tempest-VolumesExtendTest-1345140594 None] Created reservations ['74df6ea6-a3d8-4576-99e7-f02c20dfb1e6', '64ff55be-dd4e-4d44-81ec-5782c80e030e', '13365ddc-7dc4-458c-8192-ff37e5b70568', '0c70325c-8791-4acb-a166-fa2523e5e47e'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:16:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-995e10f7-d6ec-4320-8c19-980305730b90 tempest-VolumesExtendTest-1345140594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-995e10f7-d6ec-4320-8c19-980305730b90 tempest-VolumesExtendTest-1345140594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-995e10f7-d6ec-4320-8c19-980305730b90 tempest-VolumesExtendTest-1345140594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:16:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-995e10f7-d6ec-4320-8c19-980305730b90 tempest-VolumesExtendTest-1345140594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:16:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-995e10f7-d6ec-4320-8c19-980305730b90 tempest-VolumesExtendTest-1345140594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-995e10f7-d6ec-4320-8c19-980305730b90 tempest-VolumesExtendTest-1345140594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:45 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:16:45 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "cinder-quobyte-5299fe5b-a01c-4508-a298-f680de6f5d94" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:16:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-5299fe5b-a01c-4508-a298-f680de6f5d94" acquired by "delete_volume" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:16:45 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3c3be5-69ba-498e-a438-852024a3b64b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:46 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94 Jul 03 01:16:46 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:46 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-995e10f7-d6ec-4320-8c19-980305730b90 tempest-VolumesExtendTest-1345140594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.930s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:46 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-995e10f7-d6ec-4320-8c19-980305730b90 tempest-VolumesExtendTest-1345140594 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:16:46 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-995e10f7-d6ec-4320-8c19-980305730b90 tempest-VolumesExtendTest-1345140594 None] Deleted volume successfully. Jul 03 01:16:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-995e10f7-d6ec-4320-8c19-980305730b90 tempest-VolumesExtendTest-1345140594 None] Lock "cinder-18bbaa25-2de2-468b-9ab3-fa212bbff444-delete_volume" released by "delete_volume" :: held 3.194s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:16:47 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94" returned: 0 in 1.373s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:47 devstack sudo[100716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94 Jul 03 01:16:47 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:47 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5299fe5b-a01c-4508-a298-f680de6f5d94" returned: 0 in 0.800s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-5299fe5b-a01c-4508-a298-f680de6f5d94" released by "delete_volume" :: held 2.336s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:16:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "cinder-quobyte-c64b5173-7854-4d8d-8d7b-97bff08e10e5" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:16:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-c64b5173-7854-4d8d-8d7b-97bff08e10e5" acquired by "delete_volume" :: waited 0.013s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:16:47 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7f16fa-a045-4291-a381-2f7b21540e38]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:48 devstack sudo[100719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5 Jul 03 01:16:48 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:48 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5" returned: 0 in 0.914s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:48 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5 Jul 03 01:16:48 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:49 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c64b5173-7854-4d8d-8d7b-97bff08e10e5" returned: 0 in 0.835s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-c64b5173-7854-4d8d-8d7b-97bff08e10e5" released by "delete_volume" :: held 1.818s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:16:49 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] Created reservations ['5cd3257e-e7dd-41c0-8f47-57e15b6f1c19'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:16:49 devstack cinder-volume[86772]: WARNING cinder.quota [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1533549734 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1533549734, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:16:49 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] Created reservations ['7c0e70c8-7d6c-4db2-ac28-cb1a531b0e07', '5d52e632-31ce-4a2e-b9c5-1de27082def5', '5ea2c85d-41a5-4478-9dd8-1f2aca84e9ee', '35aa68f5-f47e-4ace-87b3-c4288a14f6b3'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:16:49 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] Created reservations ['abff27d8-04bc-43e6-b45c-e9e95f3865a1', 'fa9783c7-aefb-4476-a993-886e029356a4', '98be6bf5-ab46-4aad-b413-aab6a6ae9e62', 'd2e5437a-acfb-4240-86b1-2c798d7ba48b'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:16:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:16:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:16:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:50 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:16:50 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:51 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.195s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:51 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:16:51 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f520488d-adb5-4de8-a54f-2b63915ae708 tempest-GroupSnapshotsTest-1965032115 None] Delete group completed successfully. Jul 03 01:16:51 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-dd8d127e-7489-4ebe-9f5d-c98ab55ce6b5 tempest-GroupSnapshotsTest-1965032115 None] Group tempest-GroupSnapshotsTest-Group-1857164304: creating Jul 03 01:16:51 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-dd8d127e-7489-4ebe-9f5d-c98ab55ce6b5 tempest-GroupSnapshotsTest-1965032115 None] Group tempest-GroupSnapshotsTest-Group-1857164304: created successfully Jul 03 01:16:51 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-dd8d127e-7489-4ebe-9f5d-c98ab55ce6b5 tempest-GroupSnapshotsTest-1965032115 None] Create group completed successfully. Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Flow 'volume_create_manager' (09596eff-d6b0-47bb-9214-3122e00dec00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a112e0d4-69ff-46bc-b3a7-e0aa11fe1430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a112e0d4-69ff-46bc-b3a7-e0aa11fe1430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2127262220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4361b0dd-0f9b-43d5-a91c-8051ba0f904a,host='devstack@QuobyteHD#QuobyteHD',id=aae2a296-ae11-4e77-953d-bac3544bfb90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b94b8cf214470d8051e79c2d7bd31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:53Z,use_quota=True,user_id='fc5464344d954c808bfe53ee61e72184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cee1f59-b36f-4e80-84eb-5d71d4a9720b),volume_type_id=7cee1f59-b36f-4e80-84eb-5d71d4a9720b)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a86811a-8f74-4fab-9780-57fa9adb4769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a86811a-8f74-4fab-9780-57fa9adb4769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676337bb-6c74-4b3e-a184-7350c453c64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676337bb-6c74-4b3e-a184-7350c453c64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aae2a296-ae11-4e77-953d-bac3544bfb90', 'volume_name': 'volume-aae2a296-ae11-4e77-953d-bac3544bfb90', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd82932-9e3f-4e67-80fe-7bdcde470806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd82932-9e3f-4e67-80fe-7bdcde470806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4e26c2c-48f5-467c-8bd2-10af55eeb6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:53 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Volume aae2a296-ae11-4e77-953d-bac3544bfb90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aae2a296-ae11-4e77-953d-bac3544bfb90', 'volume_size': 1} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4361b0dd-0f9b-43d5-a91c-8051ba0f904a,created_at=2026-07-02T23:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2127262220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4361b0dd-0f9b-43d5-a91c-8051ba0f904a,host='devstack@QuobyteHD#QuobyteHD',id=aae2a296-ae11-4e77-953d-bac3544bfb90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b94b8cf214470d8051e79c2d7bd31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:53Z,use_quota=True,user_id='fc5464344d954c808bfe53ee61e72184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cee1f59-b36f-4e80-84eb-5d71d4a9720b),volume_type_id=7cee1f59-b36f-4e80-84eb-5d71d4a9720b)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Creating volume aae2a296-ae11-4e77-953d-bac3544bfb90 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:16:53 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:53 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90 1073741824 Jul 03 01:16:53 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Flow 'volume_create_manager' (db709072-9959-4824-8901-a1f0ecba643b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb0bf13-c1a4-4baf-a387-e230829a552f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb0bf13-c1a4-4baf-a387-e230829a552f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1267346180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=866b7bad-d5bb-46f0-96fd-030f0a98a3ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9ac41d072ba4331881c41de15d58844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:53Z,use_quota=True,user_id='986c4d699abd43b8a45a3b123a9fb95c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0056003-9ad9-4914-8e01-2b41910776cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0056003-9ad9-4914-8e01-2b41910776cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388fa5b9-3bbf-4904-8799-767313bd3dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388fa5b9-3bbf-4904-8799-767313bd3dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '866b7bad-d5bb-46f0-96fd-030f0a98a3ca', 'volume_name': 'volume-866b7bad-d5bb-46f0-96fd-030f0a98a3ca', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19af914a-53cc-444a-be2e-28fd62e3133c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19af914a-53cc-444a-be2e-28fd62e3133c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f257c6a3-f145-4ea9-b66f-2f5fe1b614b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:53 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Volume 866b7bad-d5bb-46f0-96fd-030f0a98a3ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-866b7bad-d5bb-46f0-96fd-030f0a98a3ca', 'volume_size': 1} Jul 03 01:16:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:54 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90 1073741824" returned: 0 in 0.898s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:54 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90 Jul 03 01:16:54 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:55 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90" returned: 0 in 0.783s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:16:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.581s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1267346180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=866b7bad-d5bb-46f0-96fd-030f0a98a3ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9ac41d072ba4331881c41de15d58844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:16:53Z,use_quota=True,user_id='986c4d699abd43b8a45a3b123a9fb95c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:16:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Creating volume 866b7bad-d5bb-46f0-96fd-030f0a98a3ca {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:16:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:16:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:16:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:16:55 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:16:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-866b7bad-d5bb-46f0-96fd-030f0a98a3ca 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:55 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-866b7bad-d5bb-46f0-96fd-030f0a98a3ca 1073741824 Jul 03 01:16:55 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4e26c2c-48f5-467c-8bd2-10af55eeb6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aae2a296-ae11-4e77-953d-bac3544bfb90', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01219c14-ad4c-4140-8e32-f545f24e894f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:55 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Volume volume-aae2a296-ae11-4e77-953d-bac3544bfb90 (aae2a296-ae11-4e77-953d-bac3544bfb90): created successfully Jul 03 01:16:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01219c14-ad4c-4140-8e32-f545f24e894f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Flow 'volume_create_manager' (09596eff-d6b0-47bb-9214-3122e00dec00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:55 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6404341b-4bce-48f6-820e-3aada6f1b2bb tempest-GroupSnapshotsTest-1965032115 None] Created volume successfully. Jul 03 01:16:56 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a7a002c3-c4b0-4276-a418-207c53e35ae5 tempest-GroupSnapshotsTest-1965032115 None] GroupSnapshot 530e80e2-f89c-413d-b049-b6c225b5b8a9: creating. Jul 03 01:16:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a7a002c3-c4b0-4276-a418-207c53e35ae5 tempest-GroupSnapshotsTest-1965032115 None] Group snapshot 530e80e2-f89c-413d-b049-b6c225b5b8a9: creating. {{(pid=86772) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 03 01:16:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a7a002c3-c4b0-4276-a418-207c53e35ae5 tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:16:56 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-866b7bad-d5bb-46f0-96fd-030f0a98a3ca 1073741824" returned: 0 in 1.039s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-866b7bad-d5bb-46f0-96fd-030f0a98a3ca {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:56 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-866b7bad-d5bb-46f0-96fd-030f0a98a3ca Jul 03 01:16:56 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:57 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-866b7bad-d5bb-46f0-96fd-030f0a98a3ca" returned: 0 in 1.135s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] <== create_volume: return (2285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:16:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.289s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:16:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a7a002c3-c4b0-4276-a418-207c53e35ae5 tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.386s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:16:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f257c6a3-f145-4ea9-b66f-2f5fe1b614b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-866b7bad-d5bb-46f0-96fd-030f0a98a3ca', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba77740-a184-44ab-8a8a-41cef64381ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a7a002c3-c4b0-4276-a418-207c53e35ae5 tempest-GroupSnapshotsTest-1965032115 None] Creating offline snapshot a8fae52d-b5ac-4126-9647-aadaa5a44853 of volume aae2a296-ae11-4e77-953d-bac3544bfb90 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:16:57 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Volume volume-866b7bad-d5bb-46f0-96fd-030f0a98a3ca (866b7bad-d5bb-46f0-96fd-030f0a98a3ca): created successfully Jul 03 01:16:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba77740-a184-44ab-8a8a-41cef64381ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Flow 'volume_create_manager' (db709072-9959-4824-8901-a1f0ecba643b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:57 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2759b20e-e88b-4cec-a013-67e6a7ac9c45]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:16:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a7a002c3-c4b0-4276-a418-207c53e35ae5 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:57 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-74714f5d-ec4f-4e22-bb59-75b903994213 tempest-VolumesListTestJSON-1114309249 None] Created volume successfully. Jul 03 01:16:57 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90 Jul 03 01:16:57 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:58 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a7a002c3-c4b0-4276-a418-207c53e35ae5 tempest-GroupSnapshotsTest-1965032115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90" returned: 0 in 0.827s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a7a002c3-c4b0-4276-a418-207c53e35ae5 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90.a8fae52d-b5ac-4126-9647-aadaa5a44853 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:58 devstack sudo[100864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90.a8fae52d-b5ac-4126-9647-aadaa5a44853 1G Jul 03 01:16:58 devstack sudo[100864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:59 devstack sudo[100864]: pam_unix(sudo:session): session closed for user root Jul 03 01:16:59 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:16:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Flow 'volume_create_manager' (eff88514-dd57-4015-9a33-dbb6c3fc4774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:16:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d71d7a-2fcc-4e99-9eab-eded48bde010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a7a002c3-c4b0-4276-a418-207c53e35ae5 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90.a8fae52d-b5ac-4126-9647-aadaa5a44853 1G" returned: 0 in 1.350s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:16:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a7a002c3-c4b0-4276-a418-207c53e35ae5 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aae2a296-ae11-4e77-953d-bac3544bfb90 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90.a8fae52d-b5ac-4126-9647-aadaa5a44853 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:16:59 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aae2a296-ae11-4e77-953d-bac3544bfb90 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90.a8fae52d-b5ac-4126-9647-aadaa5a44853 Jul 03 01:16:59 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:16:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d71d7a-2fcc-4e99-9eab-eded48bde010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1220394819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4587251c-ef8e-4f19-b1dc-e6d3fccef14b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9ac41d072ba4331881c41de15d58844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:17:00Z,use_quota=True,user_id='986c4d699abd43b8a45a3b123a9fb95c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460f1edd-812c-4cd9-8019-fb32b8824a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460f1edd-812c-4cd9-8019-fb32b8824a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5a439c-66ac-4710-bcd3-445b962cf597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5a439c-66ac-4710-bcd3-445b962cf597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4587251c-ef8e-4f19-b1dc-e6d3fccef14b', 'volume_name': 'volume-4587251c-ef8e-4f19-b1dc-e6d3fccef14b', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490a1335-1427-4b1f-a7cf-6f1666b9c0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490a1335-1427-4b1f-a7cf-6f1666b9c0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:16:59 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f40fb485-5361-4a63-af54-8975050f9465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:16:59 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Volume 4587251c-ef8e-4f19-b1dc-e6d3fccef14b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4587251c-ef8e-4f19-b1dc-e6d3fccef14b', 'volume_size': 1} Jul 03 01:16:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:00 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a7a002c3-c4b0-4276-a418-207c53e35ae5 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aae2a296-ae11-4e77-953d-bac3544bfb90 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90.a8fae52d-b5ac-4126-9647-aadaa5a44853" returned: 0 in 0.949s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:00 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-a7a002c3-c4b0-4276-a418-207c53e35ae5 tempest-GroupSnapshotsTest-1965032115 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90.a8fae52d-b5ac-4126-9647-aadaa5a44853 is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:17:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a7a002c3-c4b0-4276-a418-207c53e35ae5 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90.a8fae52d-b5ac-4126-9647-aadaa5a44853 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:00 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90.a8fae52d-b5ac-4126-9647-aadaa5a44853 Jul 03 01:17:00 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:01 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a7a002c3-c4b0-4276-a418-207c53e35ae5 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90.a8fae52d-b5ac-4126-9647-aadaa5a44853" returned: 0 in 0.779s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:01 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:17:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Flow 'volume_create_manager' (c6342be8-3e68-425e-aab5-9b8d953677b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:17:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (769ba850-95f9-4590-a271-6fa4a3451606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:17:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a7a002c3-c4b0-4276-a418-207c53e35ae5 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:01 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90.info Jul 03 01:17:01 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (769ba850-95f9-4590-a271-6fa4a3451606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1531828721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b33b805c-9090-4eef-a75a-5136e34a262d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba7ca267d61a4e79be662b1c8052e615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:17:01Z,use_quota=True,user_id='e7402b0b1882445ab73f814d5ee393fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:17:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf5e3fd8-7235-4ce5-8faa-5315b05f6671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:17:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf5e3fd8-7235-4ce5-8faa-5315b05f6671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:17:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f493b6ca-1378-4414-83bc-5b14f3b63cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:17:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f493b6ca-1378-4414-83bc-5b14f3b63cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b33b805c-9090-4eef-a75a-5136e34a262d', 'volume_name': 'volume-b33b805c-9090-4eef-a75a-5136e34a262d', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:17:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686ee9cd-7bcc-4166-92fd-ccd7dd0603d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:17:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686ee9cd-7bcc-4166-92fd-ccd7dd0603d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:17:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d564e33c-e996-4e1e-ac78-5e6fbd052c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:17:01 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Volume b33b805c-9090-4eef-a75a-5136e34a262d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b33b805c-9090-4eef-a75a-5136e34a262d', 'volume_size': 1} Jul 03 01:17:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:02 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a7a002c3-c4b0-4276-a418-207c53e35ae5 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90.info" returned: 0 in 0.709s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:02 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-a7a002c3-c4b0-4276-a418-207c53e35ae5 tempest-GroupSnapshotsTest-1965032115 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90.info is being set with open permissions: ugo+rw: NotImplementedError Jul 03 01:17:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a7a002c3-c4b0-4276-a418-207c53e35ae5 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:02 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90.info Jul 03 01:17:02 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-2c05d0e0-be3b-477e-a10f-5afae6e3d70a req-baa395d6-a9ef-4ee7-a9b7-042ff137add4 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:02 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a7a002c3-c4b0-4276-a418-207c53e35ae5 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90.info" returned: 0 in 0.748s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a7a002c3-c4b0-4276-a418-207c53e35ae5 tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.574s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.215s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1220394819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4587251c-ef8e-4f19-b1dc-e6d3fccef14b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9ac41d072ba4331881c41de15d58844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:17:00Z,use_quota=True,user_id='986c4d699abd43b8a45a3b123a9fb95c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:17:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Creating volume 4587251c-ef8e-4f19-b1dc-e6d3fccef14b {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:17:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:17:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:17:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:17:03 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:17:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4587251c-ef8e-4f19-b1dc-e6d3fccef14b 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:03 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4587251c-ef8e-4f19-b1dc-e6d3fccef14b 1073741824 Jul 03 01:17:03 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:03 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a7a002c3-c4b0-4276-a418-207c53e35ae5 tempest-GroupSnapshotsTest-1965032115 None] group_snapshot 530e80e2-f89c-413d-b049-b6c225b5b8a9: created successfully Jul 03 01:17:03 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8c1b8e56-9d31-4402-96d7-ce8eba955027 tempest-GroupSnapshotsTest-1965032115 None] group_snapshot 530e80e2-f89c-413d-b049-b6c225b5b8a9: deleting Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8c1b8e56-9d31-4402-96d7-ce8eba955027 tempest-GroupSnapshotsTest-1965032115 None] group_snapshot 530e80e2-f89c-413d-b049-b6c225b5b8a9: deleting {{(pid=86772) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 03 01:17:04 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4587251c-ef8e-4f19-b1dc-e6d3fccef14b 1073741824" returned: 0 in 1.020s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8c1b8e56-9d31-4402-96d7-ce8eba955027 tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "cinder-quobyte-aae2a296-ae11-4e77-953d-bac3544bfb90" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8c1b8e56-9d31-4402-96d7-ce8eba955027 tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-aae2a296-ae11-4e77-953d-bac3544bfb90" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8c1b8e56-9d31-4402-96d7-ce8eba955027 tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "cinder-quobyte-a8fae52d-b5ac-4126-9647-aadaa5a44853" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4587251c-ef8e-4f19-b1dc-e6d3fccef14b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8c1b8e56-9d31-4402-96d7-ce8eba955027 tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-a8fae52d-b5ac-4126-9647-aadaa5a44853" acquired by "_delete_snapshot" :: waited 0.065s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8c1b8e56-9d31-4402-96d7-ce8eba955027 tempest-GroupSnapshotsTest-1965032115 None] Deleting offline snapshot a8fae52d-b5ac-4126-9647-aadaa5a44853 of volume aae2a296-ae11-4e77-953d-bac3544bfb90 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:17:04 devstack sudo[100918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4587251c-ef8e-4f19-b1dc-e6d3fccef14b Jul 03 01:17:04 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8c1b8e56-9d31-4402-96d7-ce8eba955027 tempest-GroupSnapshotsTest-1965032115 None] snapshot_file for this snap is: volume-aae2a296-ae11-4e77-953d-bac3544bfb90.a8fae52d-b5ac-4126-9647-aadaa5a44853 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f907a54-2131-40d1-935c-932f08c0a293]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c1b8e56-9d31-4402-96d7-ce8eba955027 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90.a8fae52d-b5ac-4126-9647-aadaa5a44853 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:04 devstack sudo[100924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90.a8fae52d-b5ac-4126-9647-aadaa5a44853 Jul 03 01:17:04 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:04 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4587251c-ef8e-4f19-b1dc-e6d3fccef14b" returned: 0 in 0.800s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] <== create_volume: return (1886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.291s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1531828721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b33b805c-9090-4eef-a75a-5136e34a262d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba7ca267d61a4e79be662b1c8052e615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:17:01Z,use_quota=True,user_id='e7402b0b1882445ab73f814d5ee393fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Creating volume b33b805c-9090-4eef-a75a-5136e34a262d {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:17:04 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33b805c-9090-4eef-a75a-5136e34a262d 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f40fb485-5361-4a63-af54-8975050f9465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4587251c-ef8e-4f19-b1dc-e6d3fccef14b', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:17:04 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33b805c-9090-4eef-a75a-5136e34a262d 1073741824 Jul 03 01:17:04 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28068d26-5999-4952-9fe9-1d23a4053891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:17:04 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Volume volume-4587251c-ef8e-4f19-b1dc-e6d3fccef14b (4587251c-ef8e-4f19-b1dc-e6d3fccef14b): created successfully Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28068d26-5999-4952-9fe9-1d23a4053891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:17:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Flow 'volume_create_manager' (eff88514-dd57-4015-9a33-dbb6c3fc4774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:17:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-79bb880b-26e3-458e-ac44-6a11c2d25d20 tempest-VolumesListTestJSON-1114309249 None] Created volume successfully. Jul 03 01:17:05 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c1b8e56-9d31-4402-96d7-ce8eba955027 tempest-GroupSnapshotsTest-1965032115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90.a8fae52d-b5ac-4126-9647-aadaa5a44853" returned: 0 in 0.885s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8c1b8e56-9d31-4402-96d7-ce8eba955027 tempest-GroupSnapshotsTest-1965032115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aae2a296-ae11-4e77-953d-bac3544bfb90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:17:05 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[575efed1-a63c-42af-9920-23112948cd05]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:17:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c1b8e56-9d31-4402-96d7-ce8eba955027 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:05 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90 Jul 03 01:17:05 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:05 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33b805c-9090-4eef-a75a-5136e34a262d 1073741824" returned: 0 in 1.037s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33b805c-9090-4eef-a75a-5136e34a262d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:06 devstack sudo[100942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33b805c-9090-4eef-a75a-5136e34a262d Jul 03 01:17:06 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:06 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c1b8e56-9d31-4402-96d7-ce8eba955027 tempest-GroupSnapshotsTest-1965032115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90" returned: 0 in 0.942s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c1b8e56-9d31-4402-96d7-ce8eba955027 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90.a8fae52d-b5ac-4126-9647-aadaa5a44853 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:06 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90.a8fae52d-b5ac-4126-9647-aadaa5a44853 Jul 03 01:17:06 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:06 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:17:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Flow 'volume_create_manager' (f1daa81e-f388-4d38-9977-03f53623eea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:17:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29264428-5276-4eb1-9fda-495370e3a643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:17:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29264428-5276-4eb1-9fda-495370e3a643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-230382698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1efa5df-975a-4ea5-815a-9d0cb8d93ac3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9ac41d072ba4331881c41de15d58844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:17:07Z,use_quota=True,user_id='986c4d699abd43b8a45a3b123a9fb95c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:17:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b05bc87-bc15-4ca2-8a52-040462006c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:17:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b05bc87-bc15-4ca2-8a52-040462006c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:17:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c73fcf7-68fe-4d48-ab99-ef4307b0b47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:17:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c73fcf7-68fe-4d48-ab99-ef4307b0b47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1efa5df-975a-4ea5-815a-9d0cb8d93ac3', 'volume_name': 'volume-d1efa5df-975a-4ea5-815a-9d0cb8d93ac3', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:17:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c024c9-7ad6-448a-a926-c8e330979554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:17:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c024c9-7ad6-448a-a926-c8e330979554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:17:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67fee493-19ff-41cd-be4c-5481ceac0778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:17:06 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:06 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Volume d1efa5df-975a-4ea5-815a-9d0cb8d93ac3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1efa5df-975a-4ea5-815a-9d0cb8d93ac3', 'volume_size': 1} Jul 03 01:17:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33b805c-9090-4eef-a75a-5136e34a262d" returned: 0 in 0.904s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] <== create_volume: return (2026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:17:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.031s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-2c05d0e0-be3b-477e-a10f-5afae6e3d70a req-baa395d6-a9ef-4ee7-a9b7-042ff137add4 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.036s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d564e33c-e996-4e1e-ac78-5e6fbd052c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b33b805c-9090-4eef-a75a-5136e34a262d', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:17:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89096408-0d47-4bb2-9d9d-d68dbb766bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:17:06 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a3f6da-945c-45ea-9db9-841fa846c694]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:17:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-2c05d0e0-be3b-477e-a10f-5afae6e3d70a req-baa395d6-a9ef-4ee7-a9b7-042ff137add4 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33ca7e9-2e23-4841-9604-9a38551a8f51 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:07 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Volume volume-b33b805c-9090-4eef-a75a-5136e34a262d (b33b805c-9090-4eef-a75a-5136e34a262d): created successfully Jul 03 01:17:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89096408-0d47-4bb2-9d9d-d68dbb766bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:17:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Flow 'volume_create_manager' (c6342be8-3e68-425e-aab5-9b8d953677b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:17:07 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-70620912-f3a9-4263-a450-812223811894 tempest-TestMinimumBasicScenario-1642947343 None] Created volume successfully. Jul 03 01:17:07 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33ca7e9-2e23-4841-9604-9a38551a8f51 Jul 03 01:17:07 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:07 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c1b8e56-9d31-4402-96d7-ce8eba955027 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90.a8fae52d-b5ac-4126-9647-aadaa5a44853" returned: 0 in 1.068s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c1b8e56-9d31-4402-96d7-ce8eba955027 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90.a8fae52d-b5ac-4126-9647-aadaa5a44853 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:07 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90.a8fae52d-b5ac-4126-9647-aadaa5a44853 Jul 03 01:17:07 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:07 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-2c05d0e0-be3b-477e-a10f-5afae6e3d70a req-baa395d6-a9ef-4ee7-a9b7-042ff137add4 tempest-TestServerVolumeAttachmentScenario-1640996811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33ca7e9-2e23-4841-9604-9a38551a8f51" returned: 0 in 0.817s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-2c05d0e0-be3b-477e-a10f-5afae6e3d70a req-baa395d6-a9ef-4ee7-a9b7-042ff137add4 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.856s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.872s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-230382698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1efa5df-975a-4ea5-815a-9d0cb8d93ac3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9ac41d072ba4331881c41de15d58844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:17:07Z,use_quota=True,user_id='986c4d699abd43b8a45a3b123a9fb95c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:17:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Creating volume d1efa5df-975a-4ea5-815a-9d0cb8d93ac3 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:17:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:17:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:17:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:17:07 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:17:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d1efa5df-975a-4ea5-815a-9d0cb8d93ac3 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:07 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8c1b8e56-9d31-4402-96d7-ce8eba955027 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90.a8fae52d-b5ac-4126-9647-aadaa5a44853" returned: 0 in 0.672s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:07 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d1efa5df-975a-4ea5-815a-9d0cb8d93ac3 1073741824 Jul 03 01:17:07 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8c1b8e56-9d31-4402-96d7-ce8eba955027 tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-a8fae52d-b5ac-4126-9647-aadaa5a44853" released by "_delete_snapshot" :: held 3.730s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:17:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8c1b8e56-9d31-4402-96d7-ce8eba955027 tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-aae2a296-ae11-4e77-953d-bac3544bfb90" released by "delete_snapshot" :: held 3.810s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:17:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-2c05d0e0-be3b-477e-a10f-5afae6e3d70a req-baa395d6-a9ef-4ee7-a9b7-042ff137add4 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171', 'name': 'volume-b33ca7e9-2e23-4841-9604-9a38551a8f51', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '363ee1ff-6e2f-4fab-8886-e251ff0479ed', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:17:08 devstack cinder-volume[86772]: WARNING cinder.quota [None req-8c1b8e56-9d31-4402-96d7-ce8eba955027 tempest-GroupSnapshotsTest-1965032115 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-385762914 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-385762914, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:17:08 devstack cinder-volume[86772]: WARNING cinder.quota [None req-8c1b8e56-9d31-4402-96d7-ce8eba955027 tempest-GroupSnapshotsTest-1965032115 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-385762914 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-385762914, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:17:08 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-2c05d0e0-be3b-477e-a10f-5afae6e3d70a req-baa395d6-a9ef-4ee7-a9b7-042ff137add4 tempest-TestServerVolumeAttachmentScenario-1640996811 None] attachment_update completed successfully. Jul 03 01:17:08 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-8c1b8e56-9d31-4402-96d7-ce8eba955027 tempest-GroupSnapshotsTest-1965032115 None] Created reservations ['d7c41859-98b3-4b75-a5e2-2f09fd078a41', '02705de4-76a1-4a3e-a919-c16e9b95f4fc', 'fe2791f7-c041-45d3-a24c-133a7547ed20', 'c9691fe1-bcfd-4a77-8793-22208312214e'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:17:08 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8c1b8e56-9d31-4402-96d7-ce8eba955027 tempest-GroupSnapshotsTest-1965032115 None] group_snapshot 530e80e2-f89c-413d-b049-b6c225b5b8a9: deleted successfully Jul 03 01:17:08 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d1efa5df-975a-4ea5-815a-9d0cb8d93ac3 1073741824" returned: 0 in 1.003s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d1efa5df-975a-4ea5-815a-9d0cb8d93ac3 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:08 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d1efa5df-975a-4ea5-815a-9d0cb8d93ac3 Jul 03 01:17:08 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6c61e81e-7879-4681-9ed9-38a54c4342c5 tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "cinder-quobyte-aae2a296-ae11-4e77-953d-bac3544bfb90" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:17:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6c61e81e-7879-4681-9ed9-38a54c4342c5 tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-aae2a296-ae11-4e77-953d-bac3544bfb90" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:17:09 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fee44b1-d52a-4be3-8b58-465305d08425]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:17:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6c61e81e-7879-4681-9ed9-38a54c4342c5 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:09 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90 Jul 03 01:17:09 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:09 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d1efa5df-975a-4ea5-815a-9d0cb8d93ac3" returned: 0 in 0.879s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:17:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67fee493-19ff-41cd-be4c-5481ceac0778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1efa5df-975a-4ea5-815a-9d0cb8d93ac3', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:17:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d25758b4-5198-4830-aac4-d9f3d1727af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:17:09 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Volume volume-d1efa5df-975a-4ea5-815a-9d0cb8d93ac3 (d1efa5df-975a-4ea5-815a-9d0cb8d93ac3): created successfully Jul 03 01:17:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d25758b4-5198-4830-aac4-d9f3d1727af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:17:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Flow 'volume_create_manager' (f1daa81e-f388-4d38-9977-03f53623eea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:17:09 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-35494d5b-25b8-4a2e-a175-9a9276c27c00 tempest-VolumesListTestJSON-1114309249 None] Created volume successfully. Jul 03 01:17:10 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6c61e81e-7879-4681-9ed9-38a54c4342c5 tempest-GroupSnapshotsTest-1965032115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90" returned: 0 in 0.914s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6c61e81e-7879-4681-9ed9-38a54c4342c5 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:10 devstack sudo[101359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90 Jul 03 01:17:10 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:10 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6c61e81e-7879-4681-9ed9-38a54c4342c5 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-aae2a296-ae11-4e77-953d-bac3544bfb90" returned: 0 in 0.760s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6c61e81e-7879-4681-9ed9-38a54c4342c5 tempest-GroupSnapshotsTest-1965032115 None] Lock "cinder-quobyte-aae2a296-ae11-4e77-953d-bac3544bfb90" released by "delete_volume" :: held 1.762s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:17:10 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-6c61e81e-7879-4681-9ed9-38a54c4342c5 tempest-GroupSnapshotsTest-1965032115 None] Created reservations ['e79db062-0ce9-4a05-89a7-41ed495a264f'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:17:10 devstack cinder-volume[86772]: WARNING cinder.quota [None req-6c61e81e-7879-4681-9ed9-38a54c4342c5 tempest-GroupSnapshotsTest-1965032115 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-385762914 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-385762914, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:17:10 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-6c61e81e-7879-4681-9ed9-38a54c4342c5 tempest-GroupSnapshotsTest-1965032115 None] Created reservations ['034d0baf-7e19-4986-8f9b-2fae3791f1f6', '16c0df14-a518-4b51-81eb-d6cc30a29903', '84580aeb-5d57-4412-85f2-b3ad47498a86', '3d195054-f40d-47bc-9794-779303044d66'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:17:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6c61e81e-7879-4681-9ed9-38a54c4342c5 tempest-GroupSnapshotsTest-1965032115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6c61e81e-7879-4681-9ed9-38a54c4342c5 tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6c61e81e-7879-4681-9ed9-38a54c4342c5 tempest-GroupSnapshotsTest-1965032115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:17:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6c61e81e-7879-4681-9ed9-38a54c4342c5 tempest-GroupSnapshotsTest-1965032115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:17:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6c61e81e-7879-4681-9ed9-38a54c4342c5 tempest-GroupSnapshotsTest-1965032115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6c61e81e-7879-4681-9ed9-38a54c4342c5 tempest-GroupSnapshotsTest-1965032115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:11 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:17:11 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-997160a4-8f49-42c5-9a57-43989368da26 req-7ae4dcb9-2ffd-406f-ad86-f957698101f4 tempest-TestMinimumBasicScenario-1642947343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-997160a4-8f49-42c5-9a57-43989368da26 req-7ae4dcb9-2ffd-406f-ad86-f957698101f4 tempest-TestMinimumBasicScenario-1642947343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:11 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef5d346-31f3-4490-9324-0e3e34a9077c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:17:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-997160a4-8f49-42c5-9a57-43989368da26 req-7ae4dcb9-2ffd-406f-ad86-f957698101f4 tempest-TestMinimumBasicScenario-1642947343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33b805c-9090-4eef-a75a-5136e34a262d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:11 devstack sudo[101389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33b805c-9090-4eef-a75a-5136e34a262d Jul 03 01:17:11 devstack sudo[101389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:11 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6c61e81e-7879-4681-9ed9-38a54c4342c5 tempest-GroupSnapshotsTest-1965032115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.789s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:11 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-6c61e81e-7879-4681-9ed9-38a54c4342c5 tempest-GroupSnapshotsTest-1965032115 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:17:11 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6c61e81e-7879-4681-9ed9-38a54c4342c5 tempest-GroupSnapshotsTest-1965032115 None] Delete group completed successfully. Jul 03 01:17:12 devstack sudo[101389]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-997160a4-8f49-42c5-9a57-43989368da26 req-7ae4dcb9-2ffd-406f-ad86-f957698101f4 tempest-TestMinimumBasicScenario-1642947343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33b805c-9090-4eef-a75a-5136e34a262d" returned: 0 in 0.860s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-997160a4-8f49-42c5-9a57-43989368da26 req-7ae4dcb9-2ffd-406f-ad86-f957698101f4 tempest-TestMinimumBasicScenario-1642947343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.886s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-997160a4-8f49-42c5-9a57-43989368da26 req-7ae4dcb9-2ffd-406f-ad86-f957698101f4 tempest-TestMinimumBasicScenario-1642947343 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171', 'name': 'volume-b33b805c-9090-4eef-a75a-5136e34a262d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f1042ae6-f01f-47dd-8d6b-1237718d72b7', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:17:12 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-997160a4-8f49-42c5-9a57-43989368da26 req-7ae4dcb9-2ffd-406f-ad86-f957698101f4 tempest-TestMinimumBasicScenario-1642947343 None] attachment_update completed successfully. Jul 03 01:17:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:17:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:17:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:17:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:12 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:17:12 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:13 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.944s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:17:13 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:17:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:17:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:17:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e3c91d55-4768-4ec6-9679-2c16b473a2be tempest-VolumesListTestJSON-1114309249 None] Acquiring lock "cinder-d1efa5df-975a-4ea5-815a-9d0cb8d93ac3-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:17:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e3c91d55-4768-4ec6-9679-2c16b473a2be tempest-VolumesListTestJSON-1114309249 None] Lock "cinder-d1efa5df-975a-4ea5-815a-9d0cb8d93ac3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:17:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e3c91d55-4768-4ec6-9679-2c16b473a2be tempest-VolumesListTestJSON-1114309249 None] Acquiring lock "cinder-quobyte-d1efa5df-975a-4ea5-815a-9d0cb8d93ac3" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:17:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e3c91d55-4768-4ec6-9679-2c16b473a2be tempest-VolumesListTestJSON-1114309249 None] Lock "cinder-quobyte-d1efa5df-975a-4ea5-815a-9d0cb8d93ac3" acquired by "delete_volume" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:17:14 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a17bf2-12f0-448e-8789-49a3ce580ad7]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:17:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3c91d55-4768-4ec6-9679-2c16b473a2be tempest-VolumesListTestJSON-1114309249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d1efa5df-975a-4ea5-815a-9d0cb8d93ac3 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:14 devstack sudo[101402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d1efa5df-975a-4ea5-815a-9d0cb8d93ac3 Jul 03 01:17:14 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:15 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3c91d55-4768-4ec6-9679-2c16b473a2be tempest-VolumesListTestJSON-1114309249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d1efa5df-975a-4ea5-815a-9d0cb8d93ac3" returned: 0 in 1.057s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3c91d55-4768-4ec6-9679-2c16b473a2be tempest-VolumesListTestJSON-1114309249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d1efa5df-975a-4ea5-815a-9d0cb8d93ac3 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:15 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d1efa5df-975a-4ea5-815a-9d0cb8d93ac3 Jul 03 01:17:15 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:16 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3c91d55-4768-4ec6-9679-2c16b473a2be tempest-VolumesListTestJSON-1114309249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d1efa5df-975a-4ea5-815a-9d0cb8d93ac3" returned: 0 in 0.837s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e3c91d55-4768-4ec6-9679-2c16b473a2be tempest-VolumesListTestJSON-1114309249 None] Lock "cinder-quobyte-d1efa5df-975a-4ea5-815a-9d0cb8d93ac3" released by "delete_volume" :: held 1.947s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:17:16 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=95,cinder:SELECT=95,cinder:INSERT=24,cinder:DELETE=2 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:17:16 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=96,cinder:UPDATE=95,cinder:DELETE=7,cinder:INSERT=20 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:17:16 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e3c91d55-4768-4ec6-9679-2c16b473a2be tempest-VolumesListTestJSON-1114309249 None] Created reservations ['2e50a222-bc9c-4c7d-8145-dc69d5b55157', 'efff995e-1128-4b9a-a84e-ad37b933f5e9', '3d4ea3e7-22ea-46b1-9d93-05d4561ff569', '7c38b0c0-25ec-47d1-94a1-e7a74c00e07c'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:17:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e3c91d55-4768-4ec6-9679-2c16b473a2be tempest-VolumesListTestJSON-1114309249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e3c91d55-4768-4ec6-9679-2c16b473a2be tempest-VolumesListTestJSON-1114309249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e3c91d55-4768-4ec6-9679-2c16b473a2be tempest-VolumesListTestJSON-1114309249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:17:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e3c91d55-4768-4ec6-9679-2c16b473a2be tempest-VolumesListTestJSON-1114309249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:17:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e3c91d55-4768-4ec6-9679-2c16b473a2be tempest-VolumesListTestJSON-1114309249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3c91d55-4768-4ec6-9679-2c16b473a2be tempest-VolumesListTestJSON-1114309249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:16 devstack sudo[101449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:17:16 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cd514c24-6e1d-4bfb-8918-ed62c37437ae tempest-VolumesListTestJSON-1114309249 None] Acquiring lock "cinder-4587251c-ef8e-4f19-b1dc-e6d3fccef14b-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:17:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cd514c24-6e1d-4bfb-8918-ed62c37437ae tempest-VolumesListTestJSON-1114309249 None] Lock "cinder-4587251c-ef8e-4f19-b1dc-e6d3fccef14b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:17:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cd514c24-6e1d-4bfb-8918-ed62c37437ae tempest-VolumesListTestJSON-1114309249 None] Acquiring lock "cinder-quobyte-4587251c-ef8e-4f19-b1dc-e6d3fccef14b" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:17:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cd514c24-6e1d-4bfb-8918-ed62c37437ae tempest-VolumesListTestJSON-1114309249 None] Lock "cinder-quobyte-4587251c-ef8e-4f19-b1dc-e6d3fccef14b" acquired by "delete_volume" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:17:16 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ef1459-6fdc-4a1b-9505-b90b926f5714]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:17:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cd514c24-6e1d-4bfb-8918-ed62c37437ae tempest-VolumesListTestJSON-1114309249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4587251c-ef8e-4f19-b1dc-e6d3fccef14b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:16 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4587251c-ef8e-4f19-b1dc-e6d3fccef14b Jul 03 01:17:16 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:17 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3c91d55-4768-4ec6-9679-2c16b473a2be tempest-VolumesListTestJSON-1114309249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.186s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:17 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-e3c91d55-4768-4ec6-9679-2c16b473a2be tempest-VolumesListTestJSON-1114309249 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:17:17 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e3c91d55-4768-4ec6-9679-2c16b473a2be tempest-VolumesListTestJSON-1114309249 None] Deleted volume successfully. Jul 03 01:17:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e3c91d55-4768-4ec6-9679-2c16b473a2be tempest-VolumesListTestJSON-1114309249 None] Lock "cinder-d1efa5df-975a-4ea5-815a-9d0cb8d93ac3-delete_volume" released by "delete_volume" :: held 3.428s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:17:18 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cd514c24-6e1d-4bfb-8918-ed62c37437ae tempest-VolumesListTestJSON-1114309249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4587251c-ef8e-4f19-b1dc-e6d3fccef14b" returned: 0 in 1.360s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cd514c24-6e1d-4bfb-8918-ed62c37437ae tempest-VolumesListTestJSON-1114309249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4587251c-ef8e-4f19-b1dc-e6d3fccef14b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:18 devstack sudo[101463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4587251c-ef8e-4f19-b1dc-e6d3fccef14b Jul 03 01:17:18 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:18 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cd514c24-6e1d-4bfb-8918-ed62c37437ae tempest-VolumesListTestJSON-1114309249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4587251c-ef8e-4f19-b1dc-e6d3fccef14b" returned: 0 in 0.955s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cd514c24-6e1d-4bfb-8918-ed62c37437ae tempest-VolumesListTestJSON-1114309249 None] Lock "cinder-quobyte-4587251c-ef8e-4f19-b1dc-e6d3fccef14b" released by "delete_volume" :: held 2.396s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:17:19 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-cd514c24-6e1d-4bfb-8918-ed62c37437ae tempest-VolumesListTestJSON-1114309249 None] Created reservations ['607da8aa-43e6-47e2-88fa-cf9ecd6441c1', '5c25c4bc-1ca4-419b-8444-64d23fd82c0d', '6ab5f571-5fea-4b34-9aef-7a83299a997a', 'e40ac534-8f74-4679-9f29-62dc786444fb'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:17:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-9de0ac41-2c70-4648-9536-994a497ec934 req-da134644-c069-47e0-998b-1092d32c9069 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-9de0ac41-2c70-4648-9536-994a497ec934 req-da134644-c069-47e0-998b-1092d32c9069 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cd514c24-6e1d-4bfb-8918-ed62c37437ae tempest-VolumesListTestJSON-1114309249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cd514c24-6e1d-4bfb-8918-ed62c37437ae tempest-VolumesListTestJSON-1114309249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cd514c24-6e1d-4bfb-8918-ed62c37437ae tempest-VolumesListTestJSON-1114309249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:17:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cd514c24-6e1d-4bfb-8918-ed62c37437ae tempest-VolumesListTestJSON-1114309249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:17:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cd514c24-6e1d-4bfb-8918-ed62c37437ae tempest-VolumesListTestJSON-1114309249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cd514c24-6e1d-4bfb-8918-ed62c37437ae tempest-VolumesListTestJSON-1114309249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:19 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2ce400-e25d-480d-aa91-285312e16ed8]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:17:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-9de0ac41-2c70-4648-9536-994a497ec934 req-da134644-c069-47e0-998b-1092d32c9069 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4430a11b-8c74-4549-a4b2-f47a22ca3434 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:19 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:17:19 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:19 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4430a11b-8c74-4549-a4b2-f47a22ca3434 Jul 03 01:17:19 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cf3880a4-6338-4a65-badc-ae772af35c60 tempest-VolumesListTestJSON-1114309249 None] Acquiring lock "cinder-866b7bad-d5bb-46f0-96fd-030f0a98a3ca-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:17:20 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cd514c24-6e1d-4bfb-8918-ed62c37437ae tempest-VolumesListTestJSON-1114309249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.796s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:20 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-cd514c24-6e1d-4bfb-8918-ed62c37437ae tempest-VolumesListTestJSON-1114309249 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:17:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cf3880a4-6338-4a65-badc-ae772af35c60 tempest-VolumesListTestJSON-1114309249 None] Lock "cinder-866b7bad-d5bb-46f0-96fd-030f0a98a3ca-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:17:20 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-cd514c24-6e1d-4bfb-8918-ed62c37437ae tempest-VolumesListTestJSON-1114309249 None] Deleted volume successfully. Jul 03 01:17:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cd514c24-6e1d-4bfb-8918-ed62c37437ae tempest-VolumesListTestJSON-1114309249 None] Lock "cinder-4587251c-ef8e-4f19-b1dc-e6d3fccef14b-delete_volume" released by "delete_volume" :: held 3.615s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:17:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cf3880a4-6338-4a65-badc-ae772af35c60 tempest-VolumesListTestJSON-1114309249 None] Acquiring lock "cinder-quobyte-866b7bad-d5bb-46f0-96fd-030f0a98a3ca" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:17:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cf3880a4-6338-4a65-badc-ae772af35c60 tempest-VolumesListTestJSON-1114309249 None] Lock "cinder-quobyte-866b7bad-d5bb-46f0-96fd-030f0a98a3ca" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:17:20 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[47eb40cd-bafd-4a83-945b-44b6ba04f697]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:17:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cf3880a4-6338-4a65-badc-ae772af35c60 tempest-VolumesListTestJSON-1114309249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-866b7bad-d5bb-46f0-96fd-030f0a98a3ca {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:20 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-9de0ac41-2c70-4648-9536-994a497ec934 req-da134644-c069-47e0-998b-1092d32c9069 tempest-TestServerVolumeAttachmentScenario-1640996811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4430a11b-8c74-4549-a4b2-f47a22ca3434" returned: 0 in 0.982s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-9de0ac41-2c70-4648-9536-994a497ec934 req-da134644-c069-47e0-998b-1092d32c9069 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.067s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-9de0ac41-2c70-4648-9536-994a497ec934 req-da134644-c069-47e0-998b-1092d32c9069 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171', 'name': 'volume-4430a11b-8c74-4549-a4b2-f47a22ca3434', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43a9b858-bfd8-45b1-8dbe-f0499d40ddb3', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:17:20 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-866b7bad-d5bb-46f0-96fd-030f0a98a3ca Jul 03 01:17:20 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:20 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-9de0ac41-2c70-4648-9536-994a497ec934 req-da134644-c069-47e0-998b-1092d32c9069 tempest-TestServerVolumeAttachmentScenario-1640996811 None] attachment_update completed successfully. Jul 03 01:17:21 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cf3880a4-6338-4a65-badc-ae772af35c60 tempest-VolumesListTestJSON-1114309249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-866b7bad-d5bb-46f0-96fd-030f0a98a3ca" returned: 0 in 1.093s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cf3880a4-6338-4a65-badc-ae772af35c60 tempest-VolumesListTestJSON-1114309249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-866b7bad-d5bb-46f0-96fd-030f0a98a3ca {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:21 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-866b7bad-d5bb-46f0-96fd-030f0a98a3ca Jul 03 01:17:21 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:22 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cf3880a4-6338-4a65-badc-ae772af35c60 tempest-VolumesListTestJSON-1114309249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-866b7bad-d5bb-46f0-96fd-030f0a98a3ca" returned: 0 in 1.097s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cf3880a4-6338-4a65-badc-ae772af35c60 tempest-VolumesListTestJSON-1114309249 None] Lock "cinder-quobyte-866b7bad-d5bb-46f0-96fd-030f0a98a3ca" released by "delete_volume" :: held 2.270s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:17:22 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-cf3880a4-6338-4a65-badc-ae772af35c60 tempest-VolumesListTestJSON-1114309249 None] Created reservations ['53dfd35b-9e74-4304-b14e-e1534511f70a', '07614cfd-7f9f-47b4-9d3c-3fc696acf79a', 'f2a41064-856e-49bf-a8ff-2f3bbadd55f4', '90a97b86-2478-4fcf-9d23-20723239543b'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:17:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cf3880a4-6338-4a65-badc-ae772af35c60 tempest-VolumesListTestJSON-1114309249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cf3880a4-6338-4a65-badc-ae772af35c60 tempest-VolumesListTestJSON-1114309249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cf3880a4-6338-4a65-badc-ae772af35c60 tempest-VolumesListTestJSON-1114309249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:17:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cf3880a4-6338-4a65-badc-ae772af35c60 tempest-VolumesListTestJSON-1114309249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:17:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cf3880a4-6338-4a65-badc-ae772af35c60 tempest-VolumesListTestJSON-1114309249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cf3880a4-6338-4a65-badc-ae772af35c60 tempest-VolumesListTestJSON-1114309249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:22 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:17:22 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:23 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cf3880a4-6338-4a65-badc-ae772af35c60 tempest-VolumesListTestJSON-1114309249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.856s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:23 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-cf3880a4-6338-4a65-badc-ae772af35c60 tempest-VolumesListTestJSON-1114309249 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:17:23 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-cf3880a4-6338-4a65-badc-ae772af35c60 tempest-VolumesListTestJSON-1114309249 None] Deleted volume successfully. Jul 03 01:17:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cf3880a4-6338-4a65-badc-ae772af35c60 tempest-VolumesListTestJSON-1114309249 None] Lock "cinder-866b7bad-d5bb-46f0-96fd-030f0a98a3ca-delete_volume" released by "delete_volume" :: held 3.405s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:17:27 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-ff64343e-709d-4fa9-9e49-8b538e92bcdd req-85609922-9441-439e-a83a-60fff47f9456 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Terminate volume connection completed successfully. Jul 03 01:17:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-ff64343e-709d-4fa9-9e49-8b538e92bcdd req-85609922-9441-439e-a83a-60fff47f9456 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Deleting attachment 43a9b858-bfd8-45b1-8dbe-f0499d40ddb3. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:17:29 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:17:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Flow 'volume_create_manager' (db24f521-cad8-4077-a25e-a2738a33ee40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:17:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (723b5de2-3dbc-46ca-b010-16cf1a14c6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:17:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (723b5de2-3dbc-46ca-b010-16cf1a14c6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-827968158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efcdbdc2-916c-4048-af18-aff6e9e1e2ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d894c487739b4931b9ad55778db63b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:17:29Z,use_quota=True,user_id='3f192e8e78714af399d47a88b4c49bb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:17:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2553054b-ca8b-4d2b-b1f7-13782b40e37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:17:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2553054b-ca8b-4d2b-b1f7-13782b40e37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:17:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2df3813-8896-49b2-8d82-962107dfe42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:17:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2df3813-8896-49b2-8d82-962107dfe42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efcdbdc2-916c-4048-af18-aff6e9e1e2ed', 'volume_name': 'volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:17:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0722073a-51d9-4316-81eb-c2c4acb24b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:17:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0722073a-51d9-4316-81eb-c2c4acb24b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:17:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de0e024d-9f4c-4f96-8413-df03c311f265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:17:29 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Volume efcdbdc2-916c-4048-af18-aff6e9e1e2ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed', 'volume_size': 1} Jul 03 01:17:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-827968158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efcdbdc2-916c-4048-af18-aff6e9e1e2ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d894c487739b4931b9ad55778db63b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:17:29Z,use_quota=True,user_id='3f192e8e78714af399d47a88b4c49bb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:17:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Creating volume efcdbdc2-916c-4048-af18-aff6e9e1e2ed {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:17:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:17:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:17:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:17:29 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:17:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:29 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed 1073741824 Jul 03 01:17:29 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:30 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed 1073741824" returned: 0 in 1.078s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:30 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed Jul 03 01:17:30 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:30 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed" returned: 0 in 0.720s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:17:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de0e024d-9f4c-4f96-8413-df03c311f265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:17:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bbc1da5-b9a9-4c48-ab05-7b8eaffac2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:17:31 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Volume volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed (efcdbdc2-916c-4048-af18-aff6e9e1e2ed): created successfully Jul 03 01:17:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bbc1da5-b9a9-4c48-ab05-7b8eaffac2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:17:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Flow 'volume_create_manager' (db24f521-cad8-4077-a25e-a2738a33ee40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:17:31 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ce90dcde-e53a-4da5-ae5c-69a1b1f0ba42 tempest-SnapshotsActionsTest-1822048532 None] Created volume successfully. Jul 03 01:17:31 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-8493f21f-d038-402a-9429-a0178cc231c9 req-98f03b47-c262-4b49-b26f-64cd34d7782c tempest-TestServerVolumeAttachmentScenario-1640996811 None] Terminate volume connection completed successfully. Jul 03 01:17:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-8493f21f-d038-402a-9429-a0178cc231c9 req-98f03b47-c262-4b49-b26f-64cd34d7782c tempest-TestServerVolumeAttachmentScenario-1640996811 None] Deleting attachment 363ee1ff-6e2f-4fab-8886-e251ff0479ed. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:17:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bc205698-5f30-4160-af23-7e0f3a48160a tempest-SnapshotsActionsTest-1822048532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bc205698-5f30-4160-af23-7e0f3a48160a tempest-SnapshotsActionsTest-1822048532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-bc205698-5f30-4160-af23-7e0f3a48160a tempest-SnapshotsActionsTest-1822048532 None] Creating offline snapshot f2490309-7c67-40a1-a0de-20c29a868571 of volume efcdbdc2-916c-4048-af18-aff6e9e1e2ed {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:17:32 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a016b6-645d-4ecc-843a-cbd4b82869db]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:17:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bc205698-5f30-4160-af23-7e0f3a48160a tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:32 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed Jul 03 01:17:32 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:33 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bc205698-5f30-4160-af23-7e0f3a48160a tempest-SnapshotsActionsTest-1822048532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed" returned: 0 in 1.066s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bc205698-5f30-4160-af23-7e0f3a48160a tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:33 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 1G Jul 03 01:17:33 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:34 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bc205698-5f30-4160-af23-7e0f3a48160a tempest-SnapshotsActionsTest-1822048532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 1G" returned: 0 in 1.137s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bc205698-5f30-4160-af23-7e0f3a48160a tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:34 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 Jul 03 01:17:34 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:36 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bc205698-5f30-4160-af23-7e0f3a48160a tempest-SnapshotsActionsTest-1822048532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571" returned: 0 in 1.360s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:36 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-bc205698-5f30-4160-af23-7e0f3a48160a tempest-SnapshotsActionsTest-1822048532 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 is being set with open permissions: ugo+rw Jul 03 01:17:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bc205698-5f30-4160-af23-7e0f3a48160a tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:36 devstack sudo[101708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 Jul 03 01:17:36 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:37 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bc205698-5f30-4160-af23-7e0f3a48160a tempest-SnapshotsActionsTest-1822048532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571" returned: 0 in 1.155s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bc205698-5f30-4160-af23-7e0f3a48160a tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:37 devstack sudo[101723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.info Jul 03 01:17:37 devstack sudo[101723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:38 devstack sudo[101723]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bc205698-5f30-4160-af23-7e0f3a48160a tempest-SnapshotsActionsTest-1822048532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.info" returned: 0 in 1.224s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:38 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-bc205698-5f30-4160-af23-7e0f3a48160a tempest-SnapshotsActionsTest-1822048532 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.info is being set with open permissions: ugo+rw Jul 03 01:17:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bc205698-5f30-4160-af23-7e0f3a48160a tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:38 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.info Jul 03 01:17:38 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:39 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bc205698-5f30-4160-af23-7e0f3a48160a tempest-SnapshotsActionsTest-1822048532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.info" returned: 0 in 1.395s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bc205698-5f30-4160-af23-7e0f3a48160a tempest-SnapshotsActionsTest-1822048532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.482s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:39 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-bc205698-5f30-4160-af23-7e0f3a48160a tempest-SnapshotsActionsTest-1822048532 None] Create snapshot completed successfully Jul 03 01:17:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-165f57cc-f0fa-4556-90c7-ade8b81679d9 tempest-SnapshotsActionsTest-1822048532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-165f57cc-f0fa-4556-90c7-ade8b81679d9 tempest-SnapshotsActionsTest-1822048532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-165f57cc-f0fa-4556-90c7-ade8b81679d9 tempest-SnapshotsActionsTest-1822048532 None] Creating offline snapshot 9b6d3049-5818-43eb-8027-01592a99ffe1 of volume efcdbdc2-916c-4048-af18-aff6e9e1e2ed {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:17:41 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6694e67-f5e7-40fe-99fe-1cfd106ae670]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:17:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-165f57cc-f0fa-4556-90c7-ade8b81679d9 tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:41 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 Jul 03 01:17:41 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:42 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-165f57cc-f0fa-4556-90c7-ade8b81679d9 tempest-SnapshotsActionsTest-1822048532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571" returned: 0 in 1.343s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-165f57cc-f0fa-4556-90c7-ade8b81679d9 tempest-SnapshotsActionsTest-1822048532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:17:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-165f57cc-f0fa-4556-90c7-ade8b81679d9 tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.9b6d3049-5818-43eb-8027-01592a99ffe1 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:43 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.9b6d3049-5818-43eb-8027-01592a99ffe1 1G Jul 03 01:17:43 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:44 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-165f57cc-f0fa-4556-90c7-ade8b81679d9 tempest-SnapshotsActionsTest-1822048532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.9b6d3049-5818-43eb-8027-01592a99ffe1 1G" returned: 0 in 1.098s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-165f57cc-f0fa-4556-90c7-ade8b81679d9 tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.9b6d3049-5818-43eb-8027-01592a99ffe1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:44 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.9b6d3049-5818-43eb-8027-01592a99ffe1 Jul 03 01:17:44 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:45 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-165f57cc-f0fa-4556-90c7-ade8b81679d9 tempest-SnapshotsActionsTest-1822048532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.9b6d3049-5818-43eb-8027-01592a99ffe1" returned: 0 in 1.094s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:45 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-165f57cc-f0fa-4556-90c7-ade8b81679d9 tempest-SnapshotsActionsTest-1822048532 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.9b6d3049-5818-43eb-8027-01592a99ffe1 is being set with open permissions: ugo+rw Jul 03 01:17:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-165f57cc-f0fa-4556-90c7-ade8b81679d9 tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.9b6d3049-5818-43eb-8027-01592a99ffe1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:45 devstack sudo[101755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.9b6d3049-5818-43eb-8027-01592a99ffe1 Jul 03 01:17:45 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ad8fc681-7cda-46d6-b3f4-24ca03c31e11 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Acquiring lock "cinder-4430a11b-8c74-4549-a4b2-f47a22ca3434-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:17:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ad8fc681-7cda-46d6-b3f4-24ca03c31e11 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Lock "cinder-4430a11b-8c74-4549-a4b2-f47a22ca3434-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:17:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ad8fc681-7cda-46d6-b3f4-24ca03c31e11 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Acquiring lock "cinder-quobyte-4430a11b-8c74-4549-a4b2-f47a22ca3434" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:17:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ad8fc681-7cda-46d6-b3f4-24ca03c31e11 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Lock "cinder-quobyte-4430a11b-8c74-4549-a4b2-f47a22ca3434" acquired by "delete_volume" :: waited 0.038s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:17:45 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f597dfe0-a738-4a08-a615-b4cf5e402a9c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:17:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ad8fc681-7cda-46d6-b3f4-24ca03c31e11 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4430a11b-8c74-4549-a4b2-f47a22ca3434 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:45 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4430a11b-8c74-4549-a4b2-f47a22ca3434 Jul 03 01:17:45 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:46 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-165f57cc-f0fa-4556-90c7-ade8b81679d9 tempest-SnapshotsActionsTest-1822048532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.9b6d3049-5818-43eb-8027-01592a99ffe1" returned: 0 in 1.111s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-165f57cc-f0fa-4556-90c7-ade8b81679d9 tempest-SnapshotsActionsTest-1822048532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.795s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:46 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-165f57cc-f0fa-4556-90c7-ade8b81679d9 tempest-SnapshotsActionsTest-1822048532 None] Create snapshot completed successfully Jul 03 01:17:46 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ad8fc681-7cda-46d6-b3f4-24ca03c31e11 tempest-TestServerVolumeAttachmentScenario-1640996811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4430a11b-8c74-4549-a4b2-f47a22ca3434" returned: 0 in 1.019s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ad8fc681-7cda-46d6-b3f4-24ca03c31e11 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4430a11b-8c74-4549-a4b2-f47a22ca3434 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:46 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4430a11b-8c74-4549-a4b2-f47a22ca3434 Jul 03 01:17:46 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a855f2ce-da4f-4b57-9242-07f330756298 tempest-SnapshotsActionsTest-677720232 None] Acquiring lock "cinder-9b6d3049-5818-43eb-8027-01592a99ffe1-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:17:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a855f2ce-da4f-4b57-9242-07f330756298 tempest-SnapshotsActionsTest-677720232 None] Lock "cinder-9b6d3049-5818-43eb-8027-01592a99ffe1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:17:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a855f2ce-da4f-4b57-9242-07f330756298 tempest-SnapshotsActionsTest-677720232 None] Acquiring lock "cinder-quobyte-efcdbdc2-916c-4048-af18-aff6e9e1e2ed" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:17:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a855f2ce-da4f-4b57-9242-07f330756298 tempest-SnapshotsActionsTest-677720232 None] Lock "cinder-quobyte-efcdbdc2-916c-4048-af18-aff6e9e1e2ed" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:17:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a855f2ce-da4f-4b57-9242-07f330756298 tempest-SnapshotsActionsTest-677720232 None] Acquiring lock "cinder-quobyte-9b6d3049-5818-43eb-8027-01592a99ffe1" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:17:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a855f2ce-da4f-4b57-9242-07f330756298 tempest-SnapshotsActionsTest-677720232 None] Lock "cinder-quobyte-9b6d3049-5818-43eb-8027-01592a99ffe1" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:17:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a855f2ce-da4f-4b57-9242-07f330756298 tempest-SnapshotsActionsTest-677720232 None] Deleting offline snapshot 9b6d3049-5818-43eb-8027-01592a99ffe1 of volume efcdbdc2-916c-4048-af18-aff6e9e1e2ed {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:17:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a855f2ce-da4f-4b57-9242-07f330756298 tempest-SnapshotsActionsTest-677720232 None] snapshot_file for this snap is: volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.9b6d3049-5818-43eb-8027-01592a99ffe1 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:17:47 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46112ab-9497-4100-9b08-a97a8cc25efd]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:17:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a855f2ce-da4f-4b57-9242-07f330756298 tempest-SnapshotsActionsTest-677720232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.9b6d3049-5818-43eb-8027-01592a99ffe1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:47 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.9b6d3049-5818-43eb-8027-01592a99ffe1 Jul 03 01:17:47 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:47 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ad8fc681-7cda-46d6-b3f4-24ca03c31e11 tempest-TestServerVolumeAttachmentScenario-1640996811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4430a11b-8c74-4549-a4b2-f47a22ca3434" returned: 0 in 0.882s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ad8fc681-7cda-46d6-b3f4-24ca03c31e11 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Lock "cinder-quobyte-4430a11b-8c74-4549-a4b2-f47a22ca3434" released by "delete_volume" :: held 1.997s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:17:47 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-ad8fc681-7cda-46d6-b3f4-24ca03c31e11 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Created reservations ['afd2491e-39e4-4a60-9c7a-5d941ecce3bb', 'c9850273-dfbe-4bd8-9653-cf5a6c34bd48', 'f685eed7-453a-46a3-9242-624991e30285', '26397692-8462-4a8a-b0c6-4ce60a1fff47'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:17:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ad8fc681-7cda-46d6-b3f4-24ca03c31e11 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ad8fc681-7cda-46d6-b3f4-24ca03c31e11 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ad8fc681-7cda-46d6-b3f4-24ca03c31e11 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:17:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ad8fc681-7cda-46d6-b3f4-24ca03c31e11 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:17:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ad8fc681-7cda-46d6-b3f4-24ca03c31e11 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ad8fc681-7cda-46d6-b3f4-24ca03c31e11 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:47 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:17:47 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ef981106-f300-480d-a50f-5c098ceb13d9 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Acquiring lock "cinder-b33ca7e9-2e23-4841-9604-9a38551a8f51-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:17:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ef981106-f300-480d-a50f-5c098ceb13d9 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Lock "cinder-b33ca7e9-2e23-4841-9604-9a38551a8f51-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:17:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ef981106-f300-480d-a50f-5c098ceb13d9 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Acquiring lock "cinder-quobyte-b33ca7e9-2e23-4841-9604-9a38551a8f51" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:17:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ef981106-f300-480d-a50f-5c098ceb13d9 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Lock "cinder-quobyte-b33ca7e9-2e23-4841-9604-9a38551a8f51" acquired by "delete_volume" :: waited 0.040s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:17:48 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dd68c4-f31c-4613-b6ee-110ffb1da8fa]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:17:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef981106-f300-480d-a50f-5c098ceb13d9 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33ca7e9-2e23-4841-9604-9a38551a8f51 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:48 devstack sudo[101771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33ca7e9-2e23-4841-9604-9a38551a8f51 Jul 03 01:17:48 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:48 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a855f2ce-da4f-4b57-9242-07f330756298 tempest-SnapshotsActionsTest-677720232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.9b6d3049-5818-43eb-8027-01592a99ffe1" returned: 0 in 1.343s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a855f2ce-da4f-4b57-9242-07f330756298 tempest-SnapshotsActionsTest-677720232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:17:48 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[69199723-5290-4204-a520-ed46e567d208]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:17:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a855f2ce-da4f-4b57-9242-07f330756298 tempest-SnapshotsActionsTest-677720232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:48 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 Jul 03 01:17:48 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:49 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ad8fc681-7cda-46d6-b3f4-24ca03c31e11 tempest-TestServerVolumeAttachmentScenario-1640996811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.370s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:49 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-ad8fc681-7cda-46d6-b3f4-24ca03c31e11 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:17:49 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ad8fc681-7cda-46d6-b3f4-24ca03c31e11 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Deleted volume successfully. Jul 03 01:17:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ad8fc681-7cda-46d6-b3f4-24ca03c31e11 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Lock "cinder-4430a11b-8c74-4549-a4b2-f47a22ca3434-delete_volume" released by "delete_volume" :: held 3.785s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:17:49 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef981106-f300-480d-a50f-5c098ceb13d9 tempest-TestServerVolumeAttachmentScenario-1640996811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33ca7e9-2e23-4841-9604-9a38551a8f51" returned: 0 in 1.225s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef981106-f300-480d-a50f-5c098ceb13d9 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33ca7e9-2e23-4841-9604-9a38551a8f51 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:49 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33ca7e9-2e23-4841-9604-9a38551a8f51 Jul 03 01:17:49 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:49 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a855f2ce-da4f-4b57-9242-07f330756298 tempest-SnapshotsActionsTest-677720232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571" returned: 0 in 1.313s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a855f2ce-da4f-4b57-9242-07f330756298 tempest-SnapshotsActionsTest-677720232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:17:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a855f2ce-da4f-4b57-9242-07f330756298 tempest-SnapshotsActionsTest-677720232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.9b6d3049-5818-43eb-8027-01592a99ffe1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:49 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.9b6d3049-5818-43eb-8027-01592a99ffe1 Jul 03 01:17:49 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:50 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef981106-f300-480d-a50f-5c098ceb13d9 tempest-TestServerVolumeAttachmentScenario-1640996811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33ca7e9-2e23-4841-9604-9a38551a8f51" returned: 0 in 0.948s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ef981106-f300-480d-a50f-5c098ceb13d9 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Lock "cinder-quobyte-b33ca7e9-2e23-4841-9604-9a38551a8f51" released by "delete_volume" :: held 2.263s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:17:50 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-ef981106-f300-480d-a50f-5c098ceb13d9 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Created reservations ['fc99bbea-8f71-4112-975e-9672d88ed962', '5385cb6f-3a5f-4a4b-b6e1-13ca8141b42a', '49d58537-06d9-4052-815e-eb9d996d46f8', '04c2eb89-487c-49ff-bc49-e30940fd3e2c'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:17:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ef981106-f300-480d-a50f-5c098ceb13d9 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ef981106-f300-480d-a50f-5c098ceb13d9 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ef981106-f300-480d-a50f-5c098ceb13d9 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:17:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ef981106-f300-480d-a50f-5c098ceb13d9 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:17:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ef981106-f300-480d-a50f-5c098ceb13d9 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef981106-f300-480d-a50f-5c098ceb13d9 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:50 devstack sudo[101793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:17:50 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:50 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a855f2ce-da4f-4b57-9242-07f330756298 tempest-SnapshotsActionsTest-677720232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.9b6d3049-5818-43eb-8027-01592a99ffe1" returned: 0 in 1.029s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a855f2ce-da4f-4b57-9242-07f330756298 tempest-SnapshotsActionsTest-677720232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.9b6d3049-5818-43eb-8027-01592a99ffe1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:51 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.9b6d3049-5818-43eb-8027-01592a99ffe1 Jul 03 01:17:51 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:51 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef981106-f300-480d-a50f-5c098ceb13d9 tempest-TestServerVolumeAttachmentScenario-1640996811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.006s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:51 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-ef981106-f300-480d-a50f-5c098ceb13d9 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:17:51 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ef981106-f300-480d-a50f-5c098ceb13d9 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Deleted volume successfully. Jul 03 01:17:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ef981106-f300-480d-a50f-5c098ceb13d9 tempest-TestServerVolumeAttachmentScenario-1640996811 None] Lock "cinder-b33ca7e9-2e23-4841-9604-9a38551a8f51-delete_volume" released by "delete_volume" :: held 3.625s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:17:52 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a855f2ce-da4f-4b57-9242-07f330756298 tempest-SnapshotsActionsTest-677720232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.9b6d3049-5818-43eb-8027-01592a99ffe1" returned: 0 in 1.069s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a855f2ce-da4f-4b57-9242-07f330756298 tempest-SnapshotsActionsTest-677720232 None] Lock "cinder-quobyte-9b6d3049-5818-43eb-8027-01592a99ffe1" released by "_delete_snapshot" :: held 4.889s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:17:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a855f2ce-da4f-4b57-9242-07f330756298 tempest-SnapshotsActionsTest-677720232 None] Lock "cinder-quobyte-efcdbdc2-916c-4048-af18-aff6e9e1e2ed" released by "delete_snapshot" :: held 4.932s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:17:52 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-a855f2ce-da4f-4b57-9242-07f330756298 tempest-SnapshotsActionsTest-677720232 None] Created reservations ['bab0e4b0-d1e2-42b8-854b-5b5207e67cf9', '9d65b1a2-2d84-4d6d-affd-183bc92f62f0', '7c70dcad-398b-4643-9ea1-b53efff0c6c2', 'f4029c0c-323f-47a4-b80b-cedb0da4f200'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:17:52 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a855f2ce-da4f-4b57-9242-07f330756298 tempest-SnapshotsActionsTest-677720232 None] Delete snapshot completed successfully. Jul 03 01:17:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a855f2ce-da4f-4b57-9242-07f330756298 tempest-SnapshotsActionsTest-677720232 None] Lock "cinder-9b6d3049-5818-43eb-8027-01592a99ffe1-delete_snapshot" released by "delete_snapshot" :: held 5.131s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:17:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-592794fe-40af-465d-8dd8-8f5c0c7b4f55 tempest-SnapshotsActionsTest-1822048532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:17:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-592794fe-40af-465d-8dd8-8f5c0c7b4f55 tempest-SnapshotsActionsTest-1822048532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:17:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-592794fe-40af-465d-8dd8-8f5c0c7b4f55 tempest-SnapshotsActionsTest-1822048532 None] Creating offline snapshot d126d1f7-b5a7-4416-96af-20ab46b3b375 of volume efcdbdc2-916c-4048-af18-aff6e9e1e2ed {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:17:53 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dce65c-f651-4b28-9926-e78cc7f046bd]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:17:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-592794fe-40af-465d-8dd8-8f5c0c7b4f55 tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:53 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 Jul 03 01:17:53 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:54 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-592794fe-40af-465d-8dd8-8f5c0c7b4f55 tempest-SnapshotsActionsTest-1822048532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571" returned: 0 in 0.973s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-592794fe-40af-465d-8dd8-8f5c0c7b4f55 tempest-SnapshotsActionsTest-1822048532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:17:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-592794fe-40af-465d-8dd8-8f5c0c7b4f55 tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.d126d1f7-b5a7-4416-96af-20ab46b3b375 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:54 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.d126d1f7-b5a7-4416-96af-20ab46b3b375 1G Jul 03 01:17:54 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:55 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-592794fe-40af-465d-8dd8-8f5c0c7b4f55 tempest-SnapshotsActionsTest-1822048532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.d126d1f7-b5a7-4416-96af-20ab46b3b375 1G" returned: 0 in 1.083s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-592794fe-40af-465d-8dd8-8f5c0c7b4f55 tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.d126d1f7-b5a7-4416-96af-20ab46b3b375 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:55 devstack sudo[101816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.d126d1f7-b5a7-4416-96af-20ab46b3b375 Jul 03 01:17:55 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:56 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-592794fe-40af-465d-8dd8-8f5c0c7b4f55 tempest-SnapshotsActionsTest-1822048532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.d126d1f7-b5a7-4416-96af-20ab46b3b375" returned: 0 in 0.889s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:56 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-592794fe-40af-465d-8dd8-8f5c0c7b4f55 tempest-SnapshotsActionsTest-1822048532 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.d126d1f7-b5a7-4416-96af-20ab46b3b375 is being set with open permissions: ugo+rw Jul 03 01:17:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-592794fe-40af-465d-8dd8-8f5c0c7b4f55 tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.d126d1f7-b5a7-4416-96af-20ab46b3b375 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:56 devstack sudo[101821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.d126d1f7-b5a7-4416-96af-20ab46b3b375 Jul 03 01:17:56 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:57 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-592794fe-40af-465d-8dd8-8f5c0c7b4f55 tempest-SnapshotsActionsTest-1822048532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.d126d1f7-b5a7-4416-96af-20ab46b3b375" returned: 0 in 1.030s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-592794fe-40af-465d-8dd8-8f5c0c7b4f55 tempest-SnapshotsActionsTest-1822048532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.160s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:17:57 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-592794fe-40af-465d-8dd8-8f5c0c7b4f55 tempest-SnapshotsActionsTest-1822048532 None] Create snapshot completed successfully Jul 03 01:17:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7a18da64-005d-432f-b0a3-a5e9d195379d tempest-SnapshotsActionsTest-677720232 None] Acquiring lock "cinder-d126d1f7-b5a7-4416-96af-20ab46b3b375-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:17:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7a18da64-005d-432f-b0a3-a5e9d195379d tempest-SnapshotsActionsTest-677720232 None] Lock "cinder-d126d1f7-b5a7-4416-96af-20ab46b3b375-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:17:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7a18da64-005d-432f-b0a3-a5e9d195379d tempest-SnapshotsActionsTest-677720232 None] Acquiring lock "cinder-quobyte-efcdbdc2-916c-4048-af18-aff6e9e1e2ed" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:17:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7a18da64-005d-432f-b0a3-a5e9d195379d tempest-SnapshotsActionsTest-677720232 None] Lock "cinder-quobyte-efcdbdc2-916c-4048-af18-aff6e9e1e2ed" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:17:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7a18da64-005d-432f-b0a3-a5e9d195379d tempest-SnapshotsActionsTest-677720232 None] Acquiring lock "cinder-quobyte-d126d1f7-b5a7-4416-96af-20ab46b3b375" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:17:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7a18da64-005d-432f-b0a3-a5e9d195379d tempest-SnapshotsActionsTest-677720232 None] Lock "cinder-quobyte-d126d1f7-b5a7-4416-96af-20ab46b3b375" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:17:58 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7a18da64-005d-432f-b0a3-a5e9d195379d tempest-SnapshotsActionsTest-677720232 None] Deleting offline snapshot d126d1f7-b5a7-4416-96af-20ab46b3b375 of volume efcdbdc2-916c-4048-af18-aff6e9e1e2ed {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:17:58 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7a18da64-005d-432f-b0a3-a5e9d195379d tempest-SnapshotsActionsTest-677720232 None] snapshot_file for this snap is: volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.d126d1f7-b5a7-4416-96af-20ab46b3b375 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:17:58 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d422da4-5580-4fd1-9b53-27759a9f128d]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:17:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7a18da64-005d-432f-b0a3-a5e9d195379d tempest-SnapshotsActionsTest-677720232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.d126d1f7-b5a7-4416-96af-20ab46b3b375 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:58 devstack sudo[101824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.d126d1f7-b5a7-4416-96af-20ab46b3b375 Jul 03 01:17:58 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:17:59 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root Jul 03 01:17:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7a18da64-005d-432f-b0a3-a5e9d195379d tempest-SnapshotsActionsTest-677720232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.d126d1f7-b5a7-4416-96af-20ab46b3b375" returned: 0 in 1.103s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:17:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7a18da64-005d-432f-b0a3-a5e9d195379d tempest-SnapshotsActionsTest-677720232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:17:59 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cff2ba-74b5-4fc1-8be7-4de0c5dfd3c0]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:17:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7a18da64-005d-432f-b0a3-a5e9d195379d tempest-SnapshotsActionsTest-677720232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:17:59 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 Jul 03 01:17:59 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:00 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7a18da64-005d-432f-b0a3-a5e9d195379d tempest-SnapshotsActionsTest-677720232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571" returned: 0 in 0.999s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7a18da64-005d-432f-b0a3-a5e9d195379d tempest-SnapshotsActionsTest-677720232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:18:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7a18da64-005d-432f-b0a3-a5e9d195379d tempest-SnapshotsActionsTest-677720232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.d126d1f7-b5a7-4416-96af-20ab46b3b375 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:00 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.d126d1f7-b5a7-4416-96af-20ab46b3b375 Jul 03 01:18:00 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:01 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7a18da64-005d-432f-b0a3-a5e9d195379d tempest-SnapshotsActionsTest-677720232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.d126d1f7-b5a7-4416-96af-20ab46b3b375" returned: 0 in 0.986s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7a18da64-005d-432f-b0a3-a5e9d195379d tempest-SnapshotsActionsTest-677720232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.d126d1f7-b5a7-4416-96af-20ab46b3b375 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:01 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.d126d1f7-b5a7-4416-96af-20ab46b3b375 Jul 03 01:18:01 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:02 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:18:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Flow 'volume_create_manager' (0c8528d8-cb03-494d-92ad-07c35fc3bfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b87c19bb-1639-4804-aa46-b72669df199d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b87c19bb-1639-4804-aa46-b72669df199d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-159849453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f43b4c42-c5bf-4c5c-99b9-ecb8519ae017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc863b9fc774fce92ce68e3ab0a7b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:02Z,use_quota=True,user_id='d3a1db0a72d241079e01bc156f48b320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b34d75b-ad2c-4cf3-915e-1726d0a689dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b34d75b-ad2c-4cf3-915e-1726d0a689dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5edf5c93-c310-4d42-a265-5981ef910396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5edf5c93-c310-4d42-a265-5981ef910396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f43b4c42-c5bf-4c5c-99b9-ecb8519ae017', 'volume_name': 'volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35571ded-5888-4511-8b5d-fc877abe5b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35571ded-5888-4511-8b5d-fc877abe5b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d11b3586-17c6-4304-bfd0-8b5570dede50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:02 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Volume f43b4c42-c5bf-4c5c-99b9-ecb8519ae017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017', 'volume_size': 1} Jul 03 01:18:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-159849453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f43b4c42-c5bf-4c5c-99b9-ecb8519ae017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc863b9fc774fce92ce68e3ab0a7b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:02Z,use_quota=True,user_id='d3a1db0a72d241079e01bc156f48b320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:18:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Creating volume f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:18:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:18:02 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:18:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:02 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 1073741824 Jul 03 01:18:02 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:02 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7a18da64-005d-432f-b0a3-a5e9d195379d tempest-SnapshotsActionsTest-677720232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.d126d1f7-b5a7-4416-96af-20ab46b3b375" returned: 0 in 0.923s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7a18da64-005d-432f-b0a3-a5e9d195379d tempest-SnapshotsActionsTest-677720232 None] Lock "cinder-quobyte-d126d1f7-b5a7-4416-96af-20ab46b3b375" released by "_delete_snapshot" :: held 4.158s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7a18da64-005d-432f-b0a3-a5e9d195379d tempest-SnapshotsActionsTest-677720232 None] Lock "cinder-quobyte-efcdbdc2-916c-4048-af18-aff6e9e1e2ed" released by "delete_snapshot" :: held 4.193s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:02 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-7a18da64-005d-432f-b0a3-a5e9d195379d tempest-SnapshotsActionsTest-677720232 None] Created reservations ['77c3b261-5ed1-4276-9780-789476133ff3', '4097cd64-192d-4995-ac34-480f2b8316b1', 'a3113ff5-61e9-4689-a601-cb4027943325', '3db3220a-4e06-46d9-84fc-30963012fb69'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:18:03 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7a18da64-005d-432f-b0a3-a5e9d195379d tempest-SnapshotsActionsTest-677720232 None] Delete snapshot completed successfully. Jul 03 01:18:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7a18da64-005d-432f-b0a3-a5e9d195379d tempest-SnapshotsActionsTest-677720232 None] Lock "cinder-d126d1f7-b5a7-4416-96af-20ab46b3b375-delete_snapshot" released by "delete_snapshot" :: held 4.432s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:03 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 1073741824" returned: 0 in 1.410s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:04 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 Jul 03 01:18:04 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e2526bcd-e9d6-43b0-912b-cfcba48578da tempest-SnapshotsActionsTest-1822048532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:04 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017" returned: 0 in 0.820s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] <== create_volume: return (2354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:18:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.356s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e2526bcd-e9d6-43b0-912b-cfcba48578da tempest-SnapshotsActionsTest-1822048532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.364s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e2526bcd-e9d6-43b0-912b-cfcba48578da tempest-SnapshotsActionsTest-1822048532 None] Creating offline snapshot bbd9b0e3-d9f3-4263-8b9a-99e91773883e of volume efcdbdc2-916c-4048-af18-aff6e9e1e2ed {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:18:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d11b3586-17c6-4304-bfd0-8b5570dede50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7968d3-6851-498e-bbda-b076293a8ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:05 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4290d1d8-1789-43ff-8ffb-9c4d85d4b99f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2526bcd-e9d6-43b0-912b-cfcba48578da tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:05 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Volume volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 (f43b4c42-c5bf-4c5c-99b9-ecb8519ae017): created successfully Jul 03 01:18:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7968d3-6851-498e-bbda-b076293a8ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Flow 'volume_create_manager' (0c8528d8-cb03-494d-92ad-07c35fc3bfc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-de176e30-eb7a-4242-abb2-10a234d662f8 tempest-TestStampPattern-1880660764 None] Created volume successfully. Jul 03 01:18:05 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 Jul 03 01:18:05 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-febc8dfa-a763-48ca-83bf-c70f904d2953 req-9061834e-9fca-4a79-af0d-2d193a47c7ea tempest-TestMinimumBasicScenario-1642947343 None] Terminate volume connection completed successfully. Jul 03 01:18:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-febc8dfa-a763-48ca-83bf-c70f904d2953 req-9061834e-9fca-4a79-af0d-2d193a47c7ea tempest-TestMinimumBasicScenario-1642947343 None] Deleting attachment f1042ae6-f01f-47dd-8d6b-1237718d72b7. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:18:06 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2526bcd-e9d6-43b0-912b-cfcba48578da tempest-SnapshotsActionsTest-1822048532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571" returned: 0 in 1.420s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e2526bcd-e9d6-43b0-912b-cfcba48578da tempest-SnapshotsActionsTest-1822048532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:18:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2526bcd-e9d6-43b0-912b-cfcba48578da tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.bbd9b0e3-d9f3-4263-8b9a-99e91773883e 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:06 devstack sudo[101884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.bbd9b0e3-d9f3-4263-8b9a-99e91773883e 1G Jul 03 01:18:06 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:07 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2526bcd-e9d6-43b0-912b-cfcba48578da tempest-SnapshotsActionsTest-1822048532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.bbd9b0e3-d9f3-4263-8b9a-99e91773883e 1G" returned: 0 in 1.074s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2526bcd-e9d6-43b0-912b-cfcba48578da tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.bbd9b0e3-d9f3-4263-8b9a-99e91773883e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:07 devstack sudo[101890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.bbd9b0e3-d9f3-4263-8b9a-99e91773883e Jul 03 01:18:07 devstack sudo[101890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-20283c1a-77bb-4f9d-b6f3-c5c70e46d4bc tempest-TestMinimumBasicScenario-1642947343 None] Acquiring lock "cinder-b33b805c-9090-4eef-a75a-5136e34a262d-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-20283c1a-77bb-4f9d-b6f3-c5c70e46d4bc tempest-TestMinimumBasicScenario-1642947343 None] Lock "cinder-b33b805c-9090-4eef-a75a-5136e34a262d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-20283c1a-77bb-4f9d-b6f3-c5c70e46d4bc tempest-TestMinimumBasicScenario-1642947343 None] Acquiring lock "cinder-quobyte-b33b805c-9090-4eef-a75a-5136e34a262d" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-20283c1a-77bb-4f9d-b6f3-c5c70e46d4bc tempest-TestMinimumBasicScenario-1642947343 None] Lock "cinder-quobyte-b33b805c-9090-4eef-a75a-5136e34a262d" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:07 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0697ed75-a666-4314-99cc-f7d34ef2c422]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-20283c1a-77bb-4f9d-b6f3-c5c70e46d4bc tempest-TestMinimumBasicScenario-1642947343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33b805c-9090-4eef-a75a-5136e34a262d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:07 devstack sudo[101892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33b805c-9090-4eef-a75a-5136e34a262d Jul 03 01:18:08 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:08 devstack sudo[101890]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2526bcd-e9d6-43b0-912b-cfcba48578da tempest-SnapshotsActionsTest-1822048532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.bbd9b0e3-d9f3-4263-8b9a-99e91773883e" returned: 0 in 0.893s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:08 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-e2526bcd-e9d6-43b0-912b-cfcba48578da tempest-SnapshotsActionsTest-1822048532 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.bbd9b0e3-d9f3-4263-8b9a-99e91773883e is being set with open permissions: ugo+rw Jul 03 01:18:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2526bcd-e9d6-43b0-912b-cfcba48578da tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.bbd9b0e3-d9f3-4263-8b9a-99e91773883e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:08 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.bbd9b0e3-d9f3-4263-8b9a-99e91773883e Jul 03 01:18:08 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:08 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-20283c1a-77bb-4f9d-b6f3-c5c70e46d4bc tempest-TestMinimumBasicScenario-1642947343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33b805c-9090-4eef-a75a-5136e34a262d" returned: 0 in 0.924s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-20283c1a-77bb-4f9d-b6f3-c5c70e46d4bc tempest-TestMinimumBasicScenario-1642947343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33b805c-9090-4eef-a75a-5136e34a262d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:08 devstack sudo[101903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33b805c-9090-4eef-a75a-5136e34a262d Jul 03 01:18:08 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:09 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2526bcd-e9d6-43b0-912b-cfcba48578da tempest-SnapshotsActionsTest-1822048532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.bbd9b0e3-d9f3-4263-8b9a-99e91773883e" returned: 0 in 0.754s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e2526bcd-e9d6-43b0-912b-cfcba48578da tempest-SnapshotsActionsTest-1822048532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.345s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:09 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e2526bcd-e9d6-43b0-912b-cfcba48578da tempest-SnapshotsActionsTest-1822048532 None] Create snapshot completed successfully Jul 03 01:18:09 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-20283c1a-77bb-4f9d-b6f3-c5c70e46d4bc tempest-TestMinimumBasicScenario-1642947343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b33b805c-9090-4eef-a75a-5136e34a262d" returned: 0 in 0.720s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-20283c1a-77bb-4f9d-b6f3-c5c70e46d4bc tempest-TestMinimumBasicScenario-1642947343 None] Lock "cinder-quobyte-b33b805c-9090-4eef-a75a-5136e34a262d" released by "delete_volume" :: held 1.695s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:09 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-20283c1a-77bb-4f9d-b6f3-c5c70e46d4bc tempest-TestMinimumBasicScenario-1642947343 None] Created reservations ['0610cd7b-e6ae-4b89-abf8-cde88f7b9108', 'e8e9d264-af3a-4ea8-95b8-d5ef4a880397', '116614fa-5169-4936-a9df-2c0c8857fc49', 'f2d849e9-cad6-4c74-acb3-338e09a6f85d'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:18:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-20283c1a-77bb-4f9d-b6f3-c5c70e46d4bc tempest-TestMinimumBasicScenario-1642947343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-20283c1a-77bb-4f9d-b6f3-c5c70e46d4bc tempest-TestMinimumBasicScenario-1642947343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-20283c1a-77bb-4f9d-b6f3-c5c70e46d4bc tempest-TestMinimumBasicScenario-1642947343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-20283c1a-77bb-4f9d-b6f3-c5c70e46d4bc tempest-TestMinimumBasicScenario-1642947343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-20283c1a-77bb-4f9d-b6f3-c5c70e46d4bc tempest-TestMinimumBasicScenario-1642947343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-20283c1a-77bb-4f9d-b6f3-c5c70e46d4bc tempest-TestMinimumBasicScenario-1642947343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:09 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:18:09 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cede871e-63ef-4346-8d47-4d7a804e3d4f tempest-SnapshotsActionsTest-677720232 None] Acquiring lock "cinder-bbd9b0e3-d9f3-4263-8b9a-99e91773883e-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cede871e-63ef-4346-8d47-4d7a804e3d4f tempest-SnapshotsActionsTest-677720232 None] Lock "cinder-bbd9b0e3-d9f3-4263-8b9a-99e91773883e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cede871e-63ef-4346-8d47-4d7a804e3d4f tempest-SnapshotsActionsTest-677720232 None] Acquiring lock "cinder-quobyte-efcdbdc2-916c-4048-af18-aff6e9e1e2ed" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Flow 'volume_create_manager' (28bb1ae7-7947-49d3-87b7-384d2289dabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0974d7e8-bec8-4ffa-8497-9fe583ea3328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cede871e-63ef-4346-8d47-4d7a804e3d4f tempest-SnapshotsActionsTest-677720232 None] Lock "cinder-quobyte-efcdbdc2-916c-4048-af18-aff6e9e1e2ed" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cede871e-63ef-4346-8d47-4d7a804e3d4f tempest-SnapshotsActionsTest-677720232 None] Acquiring lock "cinder-quobyte-bbd9b0e3-d9f3-4263-8b9a-99e91773883e" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0974d7e8-bec8-4ffa-8497-9fe583ea3328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1317083124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2e7c99-ad59-4e5c-a96e-1699f5743b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='349f503e96eb4b39944964140d2a2aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:10Z,use_quota=True,user_id='e5590d4a2388494087da43eaecc1b86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a32abca-b4de-44b5-a0f5-ea0428cf22a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a32abca-b4de-44b5-a0f5-ea0428cf22a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e407c2ce-2ad2-483d-8cee-3606aea00d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e407c2ce-2ad2-483d-8cee-3606aea00d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a2e7c99-ad59-4e5c-a96e-1699f5743b64', 'volume_name': 'volume-6a2e7c99-ad59-4e5c-a96e-1699f5743b64', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611ad1e7-ba79-465e-8a8f-034f3a15735a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611ad1e7-ba79-465e-8a8f-034f3a15735a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7cff7aa-5e73-4ac3-a9e6-d098c45a71d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:10 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Volume 6a2e7c99-ad59-4e5c-a96e-1699f5743b64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a2e7c99-ad59-4e5c-a96e-1699f5743b64', 'volume_size': 1} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1317083124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2e7c99-ad59-4e5c-a96e-1699f5743b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='349f503e96eb4b39944964140d2a2aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:10Z,use_quota=True,user_id='e5590d4a2388494087da43eaecc1b86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Creating volume 6a2e7c99-ad59-4e5c-a96e-1699f5743b64 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:18:10 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a2e7c99-ad59-4e5c-a96e-1699f5743b64 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cede871e-63ef-4346-8d47-4d7a804e3d4f tempest-SnapshotsActionsTest-677720232 None] Lock "cinder-quobyte-bbd9b0e3-d9f3-4263-8b9a-99e91773883e" acquired by "_delete_snapshot" :: waited 0.093s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-cede871e-63ef-4346-8d47-4d7a804e3d4f tempest-SnapshotsActionsTest-677720232 None] Deleting offline snapshot bbd9b0e3-d9f3-4263-8b9a-99e91773883e of volume efcdbdc2-916c-4048-af18-aff6e9e1e2ed {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:18:10 devstack sudo[101909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a2e7c99-ad59-4e5c-a96e-1699f5743b64 1073741824 Jul 03 01:18:10 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-cede871e-63ef-4346-8d47-4d7a804e3d4f tempest-SnapshotsActionsTest-677720232 None] snapshot_file for this snap is: volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.bbd9b0e3-d9f3-4263-8b9a-99e91773883e {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6a873c-64a8-4f99-9922-82baac029c79]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cede871e-63ef-4346-8d47-4d7a804e3d4f tempest-SnapshotsActionsTest-677720232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.bbd9b0e3-d9f3-4263-8b9a-99e91773883e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:10 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.bbd9b0e3-d9f3-4263-8b9a-99e91773883e Jul 03 01:18:10 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:10 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-20283c1a-77bb-4f9d-b6f3-c5c70e46d4bc tempest-TestMinimumBasicScenario-1642947343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.964s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-20283c1a-77bb-4f9d-b6f3-c5c70e46d4bc tempest-TestMinimumBasicScenario-1642947343 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:18:10 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-20283c1a-77bb-4f9d-b6f3-c5c70e46d4bc tempest-TestMinimumBasicScenario-1642947343 None] Deleted volume successfully. Jul 03 01:18:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-20283c1a-77bb-4f9d-b6f3-c5c70e46d4bc tempest-TestMinimumBasicScenario-1642947343 None] Lock "cinder-b33b805c-9090-4eef-a75a-5136e34a262d-delete_volume" released by "delete_volume" :: held 2.920s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:11 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cede871e-63ef-4346-8d47-4d7a804e3d4f tempest-SnapshotsActionsTest-677720232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.bbd9b0e3-d9f3-4263-8b9a-99e91773883e" returned: 0 in 0.930s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-cede871e-63ef-4346-8d47-4d7a804e3d4f tempest-SnapshotsActionsTest-677720232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:18:11 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a2e7c99-ad59-4e5c-a96e-1699f5743b64 1073741824" returned: 0 in 1.056s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:11 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[168f7353-d16f-4344-900c-59b7ff0190ba]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cede871e-63ef-4346-8d47-4d7a804e3d4f tempest-SnapshotsActionsTest-677720232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a2e7c99-ad59-4e5c-a96e-1699f5743b64 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:11 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a2e7c99-ad59-4e5c-a96e-1699f5743b64 Jul 03 01:18:11 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:11 devstack sudo[101922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 Jul 03 01:18:11 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:12 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a2e7c99-ad59-4e5c-a96e-1699f5743b64" returned: 0 in 1.148s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] <== create_volume: return (2285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:18:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.288s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7cff7aa-5e73-4ac3-a9e6-d098c45a71d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a2e7c99-ad59-4e5c-a96e-1699f5743b64', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2cec74-bfce-4a49-9ae0-eb809b6dad5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:12 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Volume volume-6a2e7c99-ad59-4e5c-a96e-1699f5743b64 (6a2e7c99-ad59-4e5c-a96e-1699f5743b64): created successfully Jul 03 01:18:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2cec74-bfce-4a49-9ae0-eb809b6dad5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Flow 'volume_create_manager' (28bb1ae7-7947-49d3-87b7-384d2289dabb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:12 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4c32055b-d5a2-4c26-94d7-efa402bdd9e1 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Created volume successfully. Jul 03 01:18:12 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cede871e-63ef-4346-8d47-4d7a804e3d4f tempest-SnapshotsActionsTest-677720232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571" returned: 0 in 1.427s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-cede871e-63ef-4346-8d47-4d7a804e3d4f tempest-SnapshotsActionsTest-677720232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:18:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cede871e-63ef-4346-8d47-4d7a804e3d4f tempest-SnapshotsActionsTest-677720232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.bbd9b0e3-d9f3-4263-8b9a-99e91773883e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:12 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.bbd9b0e3-d9f3-4263-8b9a-99e91773883e Jul 03 01:18:12 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:18:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:12 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:18:12 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:14 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.270s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 28 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:18:14 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cede871e-63ef-4346-8d47-4d7a804e3d4f tempest-SnapshotsActionsTest-677720232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.bbd9b0e3-d9f3-4263-8b9a-99e91773883e" returned: 0 in 1.617s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cede871e-63ef-4346-8d47-4d7a804e3d4f tempest-SnapshotsActionsTest-677720232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.bbd9b0e3-d9f3-4263-8b9a-99e91773883e {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:14 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.bbd9b0e3-d9f3-4263-8b9a-99e91773883e Jul 03 01:18:14 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Flow 'volume_create_manager' (ee417d6b-c664-4535-8bf8-32e4479b5e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4fadcde-ab19-4723-ba1f-ecc0d123bad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4fadcde-ab19-4723-ba1f-ecc0d123bad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1987724698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fde76023-0f1b-4784-ab20-101684dfcf01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='349f503e96eb4b39944964140d2a2aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:14Z,use_quota=True,user_id='e5590d4a2388494087da43eaecc1b86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb05fdd-6638-4f2b-b87e-ec5667135d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb05fdd-6638-4f2b-b87e-ec5667135d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a63040-63ea-4c26-9a2a-6b6a5861907a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a63040-63ea-4c26-9a2a-6b6a5861907a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fde76023-0f1b-4784-ab20-101684dfcf01', 'volume_name': 'volume-fde76023-0f1b-4784-ab20-101684dfcf01', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c2773e8-d3a4-4b33-b8a7-9442fcf9b33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c2773e8-d3a4-4b33-b8a7-9442fcf9b33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (743b9c30-0193-4394-89d7-bc9a44ff4dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:14 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Volume fde76023-0f1b-4784-ab20-101684dfcf01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fde76023-0f1b-4784-ab20-101684dfcf01', 'volume_size': 1} Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1987724698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fde76023-0f1b-4784-ab20-101684dfcf01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='349f503e96eb4b39944964140d2a2aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:14Z,use_quota=True,user_id='e5590d4a2388494087da43eaecc1b86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Creating volume fde76023-0f1b-4784-ab20-101684dfcf01 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:18:14 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:18:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fde76023-0f1b-4784-ab20-101684dfcf01 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:14 devstack sudo[101998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fde76023-0f1b-4784-ab20-101684dfcf01 1073741824 Jul 03 01:18:14 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:15 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:18:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Flow 'volume_create_manager' (9bc33f02-ba4b-4f3a-a57d-736f069dc545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f0445fc-8bda-4e8a-bc6e-6e2fc04ef014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f0445fc-8bda-4e8a-bc6e-6e2fc04ef014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1612445133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8302dc5-1488-4b2e-809b-bce7070b80bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='349f503e96eb4b39944964140d2a2aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:15Z,use_quota=True,user_id='e5590d4a2388494087da43eaecc1b86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e1c1700-5aad-4b2a-8801-c0540d6d1ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e1c1700-5aad-4b2a-8801-c0540d6d1ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952b72ee-9079-463a-b7a1-82c72ee91758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952b72ee-9079-463a-b7a1-82c72ee91758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8302dc5-1488-4b2e-809b-bce7070b80bd', 'volume_name': 'volume-d8302dc5-1488-4b2e-809b-bce7070b80bd', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72fc125d-e329-4267-9061-8594a0f094a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72fc125d-e329-4267-9061-8594a0f094a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5849c24e-8677-4460-abcd-6e0bbc8ee294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:15 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Volume d8302dc5-1488-4b2e-809b-bce7070b80bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8302dc5-1488-4b2e-809b-bce7070b80bd', 'volume_size': 1} Jul 03 01:18:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:15 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cede871e-63ef-4346-8d47-4d7a804e3d4f tempest-SnapshotsActionsTest-677720232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.bbd9b0e3-d9f3-4263-8b9a-99e91773883e" returned: 0 in 1.472s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cede871e-63ef-4346-8d47-4d7a804e3d4f tempest-SnapshotsActionsTest-677720232 None] Lock "cinder-quobyte-bbd9b0e3-d9f3-4263-8b9a-99e91773883e" released by "_delete_snapshot" :: held 5.643s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:15 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:18:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Flow 'volume_create_manager' (09463e5c-87c0-4285-9cc3-6535d5115e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504fbc21-d7f1-407f-aee2-c922e655be92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cede871e-63ef-4346-8d47-4d7a804e3d4f tempest-SnapshotsActionsTest-677720232 None] Lock "cinder-quobyte-efcdbdc2-916c-4048-af18-aff6e9e1e2ed" released by "delete_snapshot" :: held 5.827s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504fbc21-d7f1-407f-aee2-c922e655be92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2029115404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e421d182-b8f9-408f-90a1-33427e321de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='349f503e96eb4b39944964140d2a2aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:16Z,use_quota=True,user_id='e5590d4a2388494087da43eaecc1b86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b4bd66-fa67-41a2-96fe-d5df704d7840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b4bd66-fa67-41a2-96fe-d5df704d7840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d903a7e-3636-47d1-92e3-69096217b1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d903a7e-3636-47d1-92e3-69096217b1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e421d182-b8f9-408f-90a1-33427e321de5', 'volume_name': 'volume-e421d182-b8f9-408f-90a1-33427e321de5', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:15 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a846aaa-dbcb-4661-ab30-f038178397a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a846aaa-dbcb-4661-ab30-f038178397a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d1b1857-d40b-4f33-988e-e6134a0f6135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:16 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Volume e421d182-b8f9-408f-90a1-33427e321de5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e421d182-b8f9-408f-90a1-33427e321de5', 'volume_size': 1} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-cede871e-63ef-4346-8d47-4d7a804e3d4f tempest-SnapshotsActionsTest-677720232 None] Created reservations ['4520b924-e739-428b-a089-e05b89aeb78b', '153d711a-9be6-4417-84f0-7266b47f4fb6', '0936358f-4832-4650-ad81-b2b8b972b7d8', '29576e2e-6538-44db-a779-941a56e60513'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:18:16 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=75,cinder:INSERT=16,cinder:UPDATE=74,cinder:DELETE=9 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:INSERT=24,cinder:UPDATE=80,cinder:SELECT=66,cinder:DELETE=4 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fde76023-0f1b-4784-ab20-101684dfcf01 1073741824" returned: 0 in 1.551s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Flow 'volume_create_manager' (04123456-225d-465e-bb9b-ce7f10cae9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6a66c0-bc8a-416f-a024-9356247d60b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:16 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-cede871e-63ef-4346-8d47-4d7a804e3d4f tempest-SnapshotsActionsTest-677720232 None] Delete snapshot completed successfully. Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6a66c0-bc8a-416f-a024-9356247d60b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-239034080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35bf00ca-0169-471d-ba74-2cf705018d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='349f503e96eb4b39944964140d2a2aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:16Z,use_quota=True,user_id='e5590d4a2388494087da43eaecc1b86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afaaa1c2-ce72-4964-bbb6-3c83170f8fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afaaa1c2-ce72-4964-bbb6-3c83170f8fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e931b8-b789-46e2-bbf3-673d66cee7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e931b8-b789-46e2-bbf3-673d66cee7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35bf00ca-0169-471d-ba74-2cf705018d2a', 'volume_name': 'volume-35bf00ca-0169-471d-ba74-2cf705018d2a', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86bd9257-52c1-4944-a943-24acaa4510e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86bd9257-52c1-4944-a943-24acaa4510e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e5fddd-33a0-4851-805e-2de2ec145ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:16 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Volume 35bf00ca-0169-471d-ba74-2cf705018d2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35bf00ca-0169-471d-ba74-2cf705018d2a', 'volume_size': 1} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cede871e-63ef-4346-8d47-4d7a804e3d4f tempest-SnapshotsActionsTest-677720232 None] Lock "cinder-bbd9b0e3-d9f3-4263-8b9a-99e91773883e-delete_snapshot" released by "delete_snapshot" :: held 6.436s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fde76023-0f1b-4784-ab20-101684dfcf01 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:16 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fde76023-0f1b-4784-ab20-101684dfcf01 Jul 03 01:18:16 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Flow 'volume_create_manager' (52ff7be5-fc31-4606-a4eb-6b0f5e62bbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8f8f31-8339-40a4-a71b-82e28815c014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8f8f31-8339-40a4-a71b-82e28815c014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1078295718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c638fb3b-d6af-4074-be7c-004ee6d471e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='349f503e96eb4b39944964140d2a2aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:17Z,use_quota=True,user_id='e5590d4a2388494087da43eaecc1b86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0852cfee-e2a6-448d-b8ff-f358f8dff0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0852cfee-e2a6-448d-b8ff-f358f8dff0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93806ef7-0003-4421-a308-40431dc28fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93806ef7-0003-4421-a308-40431dc28fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c638fb3b-d6af-4074-be7c-004ee6d471e2', 'volume_name': 'volume-c638fb3b-d6af-4074-be7c-004ee6d471e2', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0bd5e5-710f-4fb5-b923-33af70c28716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0bd5e5-710f-4fb5-b923-33af70c28716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18fbba23-6d54-4e7e-8190-73117d2e6246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:16 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Volume c638fb3b-d6af-4074-be7c-004ee6d471e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c638fb3b-d6af-4074-be7c-004ee6d471e2', 'volume_size': 1} Jul 03 01:18:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e3a2099e-a144-4818-979a-ea25bb8d321c tempest-SnapshotsActionsTest-1822048532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:17 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fde76023-0f1b-4784-ab20-101684dfcf01" returned: 0 in 0.732s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] <== create_volume: return (2627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:18:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.630s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.976s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1612445133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8302dc5-1488-4b2e-809b-bce7070b80bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='349f503e96eb4b39944964140d2a2aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:15Z,use_quota=True,user_id='e5590d4a2388494087da43eaecc1b86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:18:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Creating volume d8302dc5-1488-4b2e-809b-bce7070b80bd {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:18:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:18:17 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:18:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d8302dc5-1488-4b2e-809b-bce7070b80bd 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (743b9c30-0193-4394-89d7-bc9a44ff4dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fde76023-0f1b-4784-ab20-101684dfcf01', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:17 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d8302dc5-1488-4b2e-809b-bce7070b80bd 1073741824 Jul 03 01:18:17 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03c15aa-6576-49a6-937f-0afee283955e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:17 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Volume volume-fde76023-0f1b-4784-ab20-101684dfcf01 (fde76023-0f1b-4784-ab20-101684dfcf01): created successfully Jul 03 01:18:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03c15aa-6576-49a6-937f-0afee283955e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Flow 'volume_create_manager' (ee417d6b-c664-4535-8bf8-32e4479b5e7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:17 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-96482c5d-3f47-4a35-824b-0d36783eb218 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Created volume successfully. Jul 03 01:18:18 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d8302dc5-1488-4b2e-809b-bce7070b80bd 1073741824" returned: 0 in 0.989s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d8302dc5-1488-4b2e-809b-bce7070b80bd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:18 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d8302dc5-1488-4b2e-809b-bce7070b80bd Jul 03 01:18:18 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:19 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d8302dc5-1488-4b2e-809b-bce7070b80bd" returned: 0 in 0.734s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:18:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.038s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2029115404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e421d182-b8f9-408f-90a1-33427e321de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='349f503e96eb4b39944964140d2a2aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:16Z,use_quota=True,user_id='e5590d4a2388494087da43eaecc1b86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:18:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Creating volume e421d182-b8f9-408f-90a1-33427e321de5 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:18:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:18:19 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:18:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e421d182-b8f9-408f-90a1-33427e321de5 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5849c24e-8677-4460-abcd-6e0bbc8ee294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8302dc5-1488-4b2e-809b-bce7070b80bd', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:19 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e421d182-b8f9-408f-90a1-33427e321de5 1073741824 Jul 03 01:18:19 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e759f264-1508-4c19-8719-ef4de60000e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:19 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Volume volume-d8302dc5-1488-4b2e-809b-bce7070b80bd (d8302dc5-1488-4b2e-809b-bce7070b80bd): created successfully Jul 03 01:18:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e759f264-1508-4c19-8719-ef4de60000e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Flow 'volume_create_manager' (9bc33f02-ba4b-4f3a-a57d-736f069dc545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:19 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ea96a64e-b875-4cc5-b556-254b862a7688 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Created volume successfully. Jul 03 01:18:20 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e421d182-b8f9-408f-90a1-33427e321de5 1073741824" returned: 0 in 1.029s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e421d182-b8f9-408f-90a1-33427e321de5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:20 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e421d182-b8f9-408f-90a1-33427e321de5 Jul 03 01:18:20 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:20 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e421d182-b8f9-408f-90a1-33427e321de5" returned: 0 in 0.785s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:18:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.469s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-239034080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35bf00ca-0169-471d-ba74-2cf705018d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='349f503e96eb4b39944964140d2a2aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:16Z,use_quota=True,user_id='e5590d4a2388494087da43eaecc1b86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:18:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Creating volume 35bf00ca-0169-471d-ba74-2cf705018d2a {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:18:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:18:20 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:18:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-35bf00ca-0169-471d-ba74-2cf705018d2a 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:20 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-35bf00ca-0169-471d-ba74-2cf705018d2a 1073741824 Jul 03 01:18:20 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:21 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d1b1857-d40b-4f33-988e-e6134a0f6135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e421d182-b8f9-408f-90a1-33427e321de5', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:21 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d6432f-7832-44f5-aeb6-6e9132a126c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:21 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Volume volume-e421d182-b8f9-408f-90a1-33427e321de5 (e421d182-b8f9-408f-90a1-33427e321de5): created successfully Jul 03 01:18:21 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d6432f-7832-44f5-aeb6-6e9132a126c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:21 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Flow 'volume_create_manager' (09463e5c-87c0-4285-9cc3-6535d5115e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:21 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-34545027-02d9-414c-91ab-a3397f735242 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Created volume successfully. Jul 03 01:18:22 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-35bf00ca-0169-471d-ba74-2cf705018d2a 1073741824" returned: 0 in 1.504s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-35bf00ca-0169-471d-ba74-2cf705018d2a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:22 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-35bf00ca-0169-471d-ba74-2cf705018d2a Jul 03 01:18:22 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:23 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-35bf00ca-0169-471d-ba74-2cf705018d2a" returned: 0 in 0.754s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] <== create_volume: return (2324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:18:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.327s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.394s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1078295718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c638fb3b-d6af-4074-be7c-004ee6d471e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='349f503e96eb4b39944964140d2a2aa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:17Z,use_quota=True,user_id='e5590d4a2388494087da43eaecc1b86f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:18:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Creating volume c638fb3b-d6af-4074-be7c-004ee6d471e2 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:18:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:18:23 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:18:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c638fb3b-d6af-4074-be7c-004ee6d471e2 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e5fddd-33a0-4851-805e-2de2ec145ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35bf00ca-0169-471d-ba74-2cf705018d2a', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:23 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c638fb3b-d6af-4074-be7c-004ee6d471e2 1073741824 Jul 03 01:18:23 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6817238f-4755-45b5-b210-0c1c6c802f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:23 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Volume volume-35bf00ca-0169-471d-ba74-2cf705018d2a (35bf00ca-0169-471d-ba74-2cf705018d2a): created successfully Jul 03 01:18:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6817238f-4755-45b5-b210-0c1c6c802f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Flow 'volume_create_manager' (04123456-225d-465e-bb9b-ce7f10cae9ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:23 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7858a294-a15f-4ba9-a4a3-386490c40c9b tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Created volume successfully. Jul 03 01:18:24 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c638fb3b-d6af-4074-be7c-004ee6d471e2 1073741824" returned: 0 in 1.343s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c638fb3b-d6af-4074-be7c-004ee6d471e2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:24 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c638fb3b-d6af-4074-be7c-004ee6d471e2 Jul 03 01:18:24 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:25 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c638fb3b-d6af-4074-be7c-004ee6d471e2" returned: 0 in 0.958s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] <== create_volume: return (2361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:18:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.367s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e3a2099e-a144-4818-979a-ea25bb8d321c tempest-SnapshotsActionsTest-1822048532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.642s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18fbba23-6d54-4e7e-8190-73117d2e6246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c638fb3b-d6af-4074-be7c-004ee6d471e2', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1950c69d-9e0f-473d-8aae-a3e825436c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e3a2099e-a144-4818-979a-ea25bb8d321c tempest-SnapshotsActionsTest-1822048532 None] Creating offline snapshot 0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b of volume efcdbdc2-916c-4048-af18-aff6e9e1e2ed {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:18:25 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff58661f-2f1e-467d-8609-e072f2b15b29]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3a2099e-a144-4818-979a-ea25bb8d321c tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:25 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Volume volume-c638fb3b-d6af-4074-be7c-004ee6d471e2 (c638fb3b-d6af-4074-be7c-004ee6d471e2): created successfully Jul 03 01:18:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1950c69d-9e0f-473d-8aae-a3e825436c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Flow 'volume_create_manager' (52ff7be5-fc31-4606-a4eb-6b0f5e62bbd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:25 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-207c0a6b-9cb2-449c-b1da-95de3ed8b247 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Created volume successfully. Jul 03 01:18:26 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 Jul 03 01:18:26 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:27 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3a2099e-a144-4818-979a-ea25bb8d321c tempest-SnapshotsActionsTest-1822048532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571" returned: 0 in 1.201s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e3a2099e-a144-4818-979a-ea25bb8d321c tempest-SnapshotsActionsTest-1822048532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:18:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3a2099e-a144-4818-979a-ea25bb8d321c tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:27 devstack sudo[102173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b 1G Jul 03 01:18:27 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-55259c1a-b13a-49b5-b1a3-42051e221633 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "cinder-c638fb3b-d6af-4074-be7c-004ee6d471e2-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-55259c1a-b13a-49b5-b1a3-42051e221633 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "cinder-c638fb3b-d6af-4074-be7c-004ee6d471e2-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-55259c1a-b13a-49b5-b1a3-42051e221633 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "cinder-quobyte-c638fb3b-d6af-4074-be7c-004ee6d471e2" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-55259c1a-b13a-49b5-b1a3-42051e221633 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "cinder-quobyte-c638fb3b-d6af-4074-be7c-004ee6d471e2" acquired by "delete_volume" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:27 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[119b7df9-e517-424a-a437-3be589aaec41]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-55259c1a-b13a-49b5-b1a3-42051e221633 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c638fb3b-d6af-4074-be7c-004ee6d471e2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:27 devstack sudo[102175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c638fb3b-d6af-4074-be7c-004ee6d471e2 Jul 03 01:18:27 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:28 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3a2099e-a144-4818-979a-ea25bb8d321c tempest-SnapshotsActionsTest-1822048532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b 1G" returned: 0 in 1.517s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3a2099e-a144-4818-979a-ea25bb8d321c tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:28 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b Jul 03 01:18:28 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:28 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-55259c1a-b13a-49b5-b1a3-42051e221633 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c638fb3b-d6af-4074-be7c-004ee6d471e2" returned: 0 in 1.432s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-55259c1a-b13a-49b5-b1a3-42051e221633 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c638fb3b-d6af-4074-be7c-004ee6d471e2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:28 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c638fb3b-d6af-4074-be7c-004ee6d471e2 Jul 03 01:18:28 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:29 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3a2099e-a144-4818-979a-ea25bb8d321c tempest-SnapshotsActionsTest-1822048532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b" returned: 0 in 1.340s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:29 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-e3a2099e-a144-4818-979a-ea25bb8d321c tempest-SnapshotsActionsTest-1822048532 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b is being set with open permissions: ugo+rw Jul 03 01:18:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3a2099e-a144-4818-979a-ea25bb8d321c tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:29 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b Jul 03 01:18:29 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:30 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-55259c1a-b13a-49b5-b1a3-42051e221633 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c638fb3b-d6af-4074-be7c-004ee6d471e2" returned: 0 in 1.456s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-55259c1a-b13a-49b5-b1a3-42051e221633 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "cinder-quobyte-c638fb3b-d6af-4074-be7c-004ee6d471e2" released by "delete_volume" :: held 3.010s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:30 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-55259c1a-b13a-49b5-b1a3-42051e221633 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Created reservations ['efffb443-476a-4643-bd0e-d3a277498f86', '005f89ff-c497-4a1c-b6cb-25a560138b94', 'd2ef0a98-33e9-44fb-a072-4b28ad8d2a68', '8c1b42f6-c6fa-4150-ac8c-7c7c7ab149e3'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:18:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-55259c1a-b13a-49b5-b1a3-42051e221633 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-55259c1a-b13a-49b5-b1a3-42051e221633 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-55259c1a-b13a-49b5-b1a3-42051e221633 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-55259c1a-b13a-49b5-b1a3-42051e221633 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-55259c1a-b13a-49b5-b1a3-42051e221633 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-55259c1a-b13a-49b5-b1a3-42051e221633 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:30 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:18:30 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-20dc39da-105c-4901-9ccb-84f078bb814c tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "cinder-35bf00ca-0169-471d-ba74-2cf705018d2a-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-20dc39da-105c-4901-9ccb-84f078bb814c tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "cinder-35bf00ca-0169-471d-ba74-2cf705018d2a-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-20dc39da-105c-4901-9ccb-84f078bb814c tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "cinder-quobyte-35bf00ca-0169-471d-ba74-2cf705018d2a" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-20dc39da-105c-4901-9ccb-84f078bb814c tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "cinder-quobyte-35bf00ca-0169-471d-ba74-2cf705018d2a" acquired by "delete_volume" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:30 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1022e71f-ed6a-432d-ab0e-0c16b9569197]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-20dc39da-105c-4901-9ccb-84f078bb814c tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-35bf00ca-0169-471d-ba74-2cf705018d2a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:31 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-35bf00ca-0169-471d-ba74-2cf705018d2a Jul 03 01:18:31 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:31 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3a2099e-a144-4818-979a-ea25bb8d321c tempest-SnapshotsActionsTest-1822048532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b" returned: 0 in 1.541s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e3a2099e-a144-4818-979a-ea25bb8d321c tempest-SnapshotsActionsTest-1822048532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.879s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:31 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e3a2099e-a144-4818-979a-ea25bb8d321c tempest-SnapshotsActionsTest-1822048532 None] Create snapshot completed successfully Jul 03 01:18:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e7807fd4-5c8e-42eb-b7bd-0bd405f8dbbc tempest-SnapshotsActionsTest-677720232 None] Acquiring lock "cinder-0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:32 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-55259c1a-b13a-49b5-b1a3-42051e221633 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.564s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:32 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-55259c1a-b13a-49b5-b1a3-42051e221633 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:18:32 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-55259c1a-b13a-49b5-b1a3-42051e221633 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Deleted volume successfully. Jul 03 01:18:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e7807fd4-5c8e-42eb-b7bd-0bd405f8dbbc tempest-SnapshotsActionsTest-677720232 None] Lock "cinder-0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e7807fd4-5c8e-42eb-b7bd-0bd405f8dbbc tempest-SnapshotsActionsTest-677720232 None] Acquiring lock "cinder-quobyte-efcdbdc2-916c-4048-af18-aff6e9e1e2ed" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-55259c1a-b13a-49b5-b1a3-42051e221633 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "cinder-c638fb3b-d6af-4074-be7c-004ee6d471e2-delete_volume" released by "delete_volume" :: held 4.981s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e7807fd4-5c8e-42eb-b7bd-0bd405f8dbbc tempest-SnapshotsActionsTest-677720232 None] Lock "cinder-quobyte-efcdbdc2-916c-4048-af18-aff6e9e1e2ed" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e7807fd4-5c8e-42eb-b7bd-0bd405f8dbbc tempest-SnapshotsActionsTest-677720232 None] Acquiring lock "cinder-quobyte-0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e7807fd4-5c8e-42eb-b7bd-0bd405f8dbbc tempest-SnapshotsActionsTest-677720232 None] Lock "cinder-quobyte-0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e7807fd4-5c8e-42eb-b7bd-0bd405f8dbbc tempest-SnapshotsActionsTest-677720232 None] Deleting offline snapshot 0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b of volume efcdbdc2-916c-4048-af18-aff6e9e1e2ed {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:18:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e7807fd4-5c8e-42eb-b7bd-0bd405f8dbbc tempest-SnapshotsActionsTest-677720232 None] snapshot_file for this snap is: volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:18:32 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb40549-d2ab-41b8-b7ad-d715bc334b86]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e7807fd4-5c8e-42eb-b7bd-0bd405f8dbbc tempest-SnapshotsActionsTest-677720232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:32 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-20dc39da-105c-4901-9ccb-84f078bb814c tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-35bf00ca-0169-471d-ba74-2cf705018d2a" returned: 0 in 1.401s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-20dc39da-105c-4901-9ccb-84f078bb814c tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-35bf00ca-0169-471d-ba74-2cf705018d2a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:32 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-35bf00ca-0169-471d-ba74-2cf705018d2a Jul 03 01:18:32 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:32 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b Jul 03 01:18:32 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:33 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e7807fd4-5c8e-42eb-b7bd-0bd405f8dbbc tempest-SnapshotsActionsTest-677720232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b" returned: 0 in 0.972s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e7807fd4-5c8e-42eb-b7bd-0bd405f8dbbc tempest-SnapshotsActionsTest-677720232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:18:33 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-20dc39da-105c-4901-9ccb-84f078bb814c tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-35bf00ca-0169-471d-ba74-2cf705018d2a" returned: 0 in 0.922s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:33 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc8e652-8c36-4053-889a-0e34c07f1a77]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e7807fd4-5c8e-42eb-b7bd-0bd405f8dbbc tempest-SnapshotsActionsTest-677720232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-20dc39da-105c-4901-9ccb-84f078bb814c tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "cinder-quobyte-35bf00ca-0169-471d-ba74-2cf705018d2a" released by "delete_volume" :: held 2.422s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:33 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-20dc39da-105c-4901-9ccb-84f078bb814c tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Created reservations ['9e086880-fb38-4b3a-b011-5e7b054951d1', 'efd4b4f4-7032-4824-99a2-9d1ece802b3a', 'e97b5993-d75a-42e9-8457-e45d7c8af10e', 'fb2d7ca8-cdd4-48d6-b59b-1ff4009870c0'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:18:33 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 Jul 03 01:18:33 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-20dc39da-105c-4901-9ccb-84f078bb814c tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-20dc39da-105c-4901-9ccb-84f078bb814c tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-20dc39da-105c-4901-9ccb-84f078bb814c tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-20dc39da-105c-4901-9ccb-84f078bb814c tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-20dc39da-105c-4901-9ccb-84f078bb814c tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-20dc39da-105c-4901-9ccb-84f078bb814c tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:33 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:18:33 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-79e696e8-9f75-4a4d-bee1-aa70a04d9709 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "cinder-e421d182-b8f9-408f-90a1-33427e321de5-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-79e696e8-9f75-4a4d-bee1-aa70a04d9709 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "cinder-e421d182-b8f9-408f-90a1-33427e321de5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:34 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-20dc39da-105c-4901-9ccb-84f078bb814c tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.941s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-20dc39da-105c-4901-9ccb-84f078bb814c tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:18:34 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-20dc39da-105c-4901-9ccb-84f078bb814c tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Deleted volume successfully. Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-79e696e8-9f75-4a4d-bee1-aa70a04d9709 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "cinder-quobyte-e421d182-b8f9-408f-90a1-33427e321de5" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:34 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Flow 'volume_create_manager' (e14460a4-1e5f-4243-b2c5-c807b23186e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdbec5a2-7175-4c16-b543-fbb37a39c73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-20dc39da-105c-4901-9ccb-84f078bb814c tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "cinder-35bf00ca-0169-471d-ba74-2cf705018d2a-delete_volume" released by "delete_volume" :: held 3.867s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e7807fd4-5c8e-42eb-b7bd-0bd405f8dbbc tempest-SnapshotsActionsTest-677720232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571" returned: 0 in 1.325s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e7807fd4-5c8e-42eb-b7bd-0bd405f8dbbc tempest-SnapshotsActionsTest-677720232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e7807fd4-5c8e-42eb-b7bd-0bd405f8dbbc tempest-SnapshotsActionsTest-677720232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-79e696e8-9f75-4a4d-bee1-aa70a04d9709 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "cinder-quobyte-e421d182-b8f9-408f-90a1-33427e321de5" acquired by "delete_volume" :: waited 0.077s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:34 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b Jul 03 01:18:34 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdbec5a2-7175-4c16-b543-fbb37a39c73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-317186165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456187d5-9dd9-4bba-8690-f780dd4f01a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fedf400d9fd240cfa196e45103ef78f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:34Z,use_quota=True,user_id='ff46fe6e43fb4417a06e960e316f9122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8275516d-7431-47dd-a321-42d8c3f347aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8275516d-7431-47dd-a321-42d8c3f347aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a33f44a-e25f-474f-b757-7b141aa8f200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a33f44a-e25f-474f-b757-7b141aa8f200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '456187d5-9dd9-4bba-8690-f780dd4f01a0', 'volume_name': 'volume-456187d5-9dd9-4bba-8690-f780dd4f01a0', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0143172a-c641-4c0d-a4c6-db23a14ff6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0143172a-c641-4c0d-a4c6-db23a14ff6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f69b8433-a051-46da-a300-0291f15d7548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:34 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Volume 456187d5-9dd9-4bba-8690-f780dd4f01a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-456187d5-9dd9-4bba-8690-f780dd4f01a0', 'volume_size': 1} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-317186165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456187d5-9dd9-4bba-8690-f780dd4f01a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fedf400d9fd240cfa196e45103ef78f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:34Z,use_quota=True,user_id='ff46fe6e43fb4417a06e960e316f9122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Creating volume 456187d5-9dd9-4bba-8690-f780dd4f01a0 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:18:34 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-456187d5-9dd9-4bba-8690-f780dd4f01a0 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a17e13d-6208-455a-a559-7e05cee0c54a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-79e696e8-9f75-4a4d-bee1-aa70a04d9709 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e421d182-b8f9-408f-90a1-33427e321de5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:34 devstack sudo[102226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-456187d5-9dd9-4bba-8690-f780dd4f01a0 1073741824 Jul 03 01:18:34 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:35 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:18:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Flow 'volume_create_manager' (5826ea5f-e634-47ce-8de1-9c92f5d3dc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ab7c36-f27d-4560-84a0-2845079f3c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:35 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e421d182-b8f9-408f-90a1-33427e321de5 Jul 03 01:18:35 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ab7c36-f27d-4560-84a0-2845079f3c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-754991009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44beb620-6a4a-4cf9-bb8f-1a1a1270d69c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fedf400d9fd240cfa196e45103ef78f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:35Z,use_quota=True,user_id='ff46fe6e43fb4417a06e960e316f9122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc25be3-d62b-4a74-a9d3-e7d635d29d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc25be3-d62b-4a74-a9d3-e7d635d29d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a42bdf-e8ef-4e15-a854-aee32b1704af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a42bdf-e8ef-4e15-a854-aee32b1704af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44beb620-6a4a-4cf9-bb8f-1a1a1270d69c', 'volume_name': 'volume-44beb620-6a4a-4cf9-bb8f-1a1a1270d69c', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb16a915-b56b-4212-a539-628dd18baff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb16a915-b56b-4212-a539-628dd18baff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d56965d-782d-475b-878f-9dc2087ee381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:35 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Volume 44beb620-6a4a-4cf9-bb8f-1a1a1270d69c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44beb620-6a4a-4cf9-bb8f-1a1a1270d69c', 'volume_size': 1} Jul 03 01:18:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:35 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:18:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Flow 'volume_create_manager' (fde6f7dc-d589-43c2-a869-bba95ab8f961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c65985-aa43-4a30-b655-ddcdaeb9ae6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c65985-aa43-4a30-b655-ddcdaeb9ae6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2029007830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c0fbbe-591d-440f-becc-a19005cbbec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fedf400d9fd240cfa196e45103ef78f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:36Z,use_quota=True,user_id='ff46fe6e43fb4417a06e960e316f9122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (778e2816-6b51-4fb1-abc4-bd7a14829f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (778e2816-6b51-4fb1-abc4-bd7a14829f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b74386ee-0ce5-4688-ae1e-12bcd75c0f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b74386ee-0ce5-4688-ae1e-12bcd75c0f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44c0fbbe-591d-440f-becc-a19005cbbec3', 'volume_name': 'volume-44c0fbbe-591d-440f-becc-a19005cbbec3', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4628c67-eace-4a6a-afb5-2a19a8e6ecdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4628c67-eace-4a6a-afb5-2a19a8e6ecdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cbcf55f-9a51-4cea-a31c-89ffbd84ad65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:35 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Volume 44c0fbbe-591d-440f-becc-a19005cbbec3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44c0fbbe-591d-440f-becc-a19005cbbec3', 'volume_size': 1} Jul 03 01:18:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:36 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e7807fd4-5c8e-42eb-b7bd-0bd405f8dbbc tempest-SnapshotsActionsTest-677720232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b" returned: 0 in 1.416s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e7807fd4-5c8e-42eb-b7bd-0bd405f8dbbc tempest-SnapshotsActionsTest-677720232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:36 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b Jul 03 01:18:36 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:36 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-456187d5-9dd9-4bba-8690-f780dd4f01a0 1073741824" returned: 0 in 1.435s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-456187d5-9dd9-4bba-8690-f780dd4f01a0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:36 devstack sudo[102268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-456187d5-9dd9-4bba-8690-f780dd4f01a0 Jul 03 01:18:36 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:36 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:18:36 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Flow 'volume_create_manager' (3ddf1f51-a9e8-4ef6-8511-2173b172a28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204b5c1e-409c-44cc-a45b-c1caaf52fa5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-79e696e8-9f75-4a4d-bee1-aa70a04d9709 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e421d182-b8f9-408f-90a1-33427e321de5" returned: 0 in 1.616s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-79e696e8-9f75-4a4d-bee1-aa70a04d9709 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e421d182-b8f9-408f-90a1-33427e321de5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204b5c1e-409c-44cc-a45b-c1caaf52fa5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-829349353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=356c1c5f-0e58-47c5-8b75-4e9682e168e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fedf400d9fd240cfa196e45103ef78f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:36Z,use_quota=True,user_id='ff46fe6e43fb4417a06e960e316f9122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cbe15de-1821-47f8-8330-15f321e169a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:36 devstack sudo[102270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e421d182-b8f9-408f-90a1-33427e321de5 Jul 03 01:18:36 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cbe15de-1821-47f8-8330-15f321e169a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2024f4e3-da7b-42c0-8125-4112dfdb1c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2024f4e3-da7b-42c0-8125-4112dfdb1c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '356c1c5f-0e58-47c5-8b75-4e9682e168e1', 'volume_name': 'volume-356c1c5f-0e58-47c5-8b75-4e9682e168e1', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5facf3bd-590c-4443-b6f5-9be150315564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5facf3bd-590c-4443-b6f5-9be150315564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b962d7b-e6a7-4b92-b142-b7f96e26748e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:36 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Volume 356c1c5f-0e58-47c5-8b75-4e9682e168e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-356c1c5f-0e58-47c5-8b75-4e9682e168e1', 'volume_size': 1} Jul 03 01:18:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:36 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:18:36 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Flow 'volume_create_manager' (1dc669cc-0065-4a47-9167-d18b9d4fd82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f84c01-bc0f-46fc-8c9d-c6ddfc99ebc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e7807fd4-5c8e-42eb-b7bd-0bd405f8dbbc tempest-SnapshotsActionsTest-677720232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b" returned: 0 in 0.955s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e7807fd4-5c8e-42eb-b7bd-0bd405f8dbbc tempest-SnapshotsActionsTest-677720232 None] Lock "cinder-quobyte-0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b" released by "_delete_snapshot" :: held 4.834s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f84c01-bc0f-46fc-8c9d-c6ddfc99ebc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-967446908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fedf400d9fd240cfa196e45103ef78f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:37Z,use_quota=True,user_id='ff46fe6e43fb4417a06e960e316f9122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8203c86c-f726-4dde-8e26-972b20036194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8203c86c-f726-4dde-8e26-972b20036194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea5bb90-9905-40be-bb39-fed0cf3ee678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea5bb90-9905-40be-bb39-fed0cf3ee678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c', 'volume_name': 'volume-fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1abfbb9-2ca0-40ff-90a4-37ae1ee9186e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1abfbb9-2ca0-40ff-90a4-37ae1ee9186e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbcb685b-fe6b-401c-a8a5-4b1efcfdb8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:37 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Volume fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c', 'volume_size': 1} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e7807fd4-5c8e-42eb-b7bd-0bd405f8dbbc tempest-SnapshotsActionsTest-677720232 None] Lock "cinder-quobyte-efcdbdc2-916c-4048-af18-aff6e9e1e2ed" released by "delete_snapshot" :: held 4.929s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e7807fd4-5c8e-42eb-b7bd-0bd405f8dbbc tempest-SnapshotsActionsTest-677720232 None] Created reservations ['f0cc5278-7724-472d-9196-633142cfb786', '7a30e098-4c66-4d00-89f4-737a3f916c06', '3c3872ed-1358-469f-b9a3-8a967fad8914', '2d8920aa-2468-432c-9f7e-3e93e5bf7ae4'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:18:37 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-456187d5-9dd9-4bba-8690-f780dd4f01a0" returned: 0 in 0.863s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] <== create_volume: return (2396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.401s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.953s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-754991009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44beb620-6a4a-4cf9-bb8f-1a1a1270d69c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fedf400d9fd240cfa196e45103ef78f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:35Z,use_quota=True,user_id='ff46fe6e43fb4417a06e960e316f9122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Creating volume 44beb620-6a4a-4cf9-bb8f-1a1a1270d69c {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:18:37 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44beb620-6a4a-4cf9-bb8f-1a1a1270d69c 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:37 devstack sudo[102275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44beb620-6a4a-4cf9-bb8f-1a1a1270d69c 1073741824 Jul 03 01:18:37 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f69b8433-a051-46da-a300-0291f15d7548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-456187d5-9dd9-4bba-8690-f780dd4f01a0', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (082886e9-99c0-4ac2-95ac-86b8eb216e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:37 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Volume volume-456187d5-9dd9-4bba-8690-f780dd4f01a0 (456187d5-9dd9-4bba-8690-f780dd4f01a0): created successfully Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (082886e9-99c0-4ac2-95ac-86b8eb216e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Flow 'volume_create_manager' (e14460a4-1e5f-4243-b2c5-c807b23186e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:37 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e7807fd4-5c8e-42eb-b7bd-0bd405f8dbbc tempest-SnapshotsActionsTest-677720232 None] Delete snapshot completed successfully. Jul 03 01:18:37 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-97e48725-a02d-4823-96aa-7e2444407b73 tempest-CreateVolumesFromImageTest-2067186965 None] Created volume successfully. Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e7807fd4-5c8e-42eb-b7bd-0bd405f8dbbc tempest-SnapshotsActionsTest-677720232 None] Lock "cinder-0db66cbb-8fb8-4aef-a07f-8fbe5d6ace9b-delete_snapshot" released by "delete_snapshot" :: held 5.160s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:37 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-79e696e8-9f75-4a4d-bee1-aa70a04d9709 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e421d182-b8f9-408f-90a1-33427e321de5" returned: 0 in 0.884s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-79e696e8-9f75-4a4d-bee1-aa70a04d9709 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "cinder-quobyte-e421d182-b8f9-408f-90a1-33427e321de5" released by "delete_volume" :: held 2.709s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-79e696e8-9f75-4a4d-bee1-aa70a04d9709 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Created reservations ['13d8d6f6-8bac-43e5-a27e-62100c7a9f64', '041b9ee3-71b4-4065-b628-d5bef6e93022', 'f1967ca9-aede-4b07-b512-9b7905e923d1', '5480d493-cf9e-4aac-8261-572a69300939'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-79e696e8-9f75-4a4d-bee1-aa70a04d9709 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-79e696e8-9f75-4a4d-bee1-aa70a04d9709 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-79e696e8-9f75-4a4d-bee1-aa70a04d9709 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-79e696e8-9f75-4a4d-bee1-aa70a04d9709 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-79e696e8-9f75-4a4d-bee1-aa70a04d9709 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-79e696e8-9f75-4a4d-bee1-aa70a04d9709 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:37 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:18:37 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-91c8e113-7ac4-4448-a060-f6b3d45b40cd tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "cinder-d8302dc5-1488-4b2e-809b-bce7070b80bd-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-91c8e113-7ac4-4448-a060-f6b3d45b40cd tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "cinder-d8302dc5-1488-4b2e-809b-bce7070b80bd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-91c8e113-7ac4-4448-a060-f6b3d45b40cd tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "cinder-quobyte-d8302dc5-1488-4b2e-809b-bce7070b80bd" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-91c8e113-7ac4-4448-a060-f6b3d45b40cd tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "cinder-quobyte-d8302dc5-1488-4b2e-809b-bce7070b80bd" acquired by "delete_volume" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:38 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28c1a07-bdd0-45bb-811f-d7d246e2fada]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-91c8e113-7ac4-4448-a060-f6b3d45b40cd tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d8302dc5-1488-4b2e-809b-bce7070b80bd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:38 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44beb620-6a4a-4cf9-bb8f-1a1a1270d69c 1073741824" returned: 0 in 1.013s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:38 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-79e696e8-9f75-4a4d-bee1-aa70a04d9709 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.749s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:38 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-79e696e8-9f75-4a4d-bee1-aa70a04d9709 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:18:38 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-79e696e8-9f75-4a4d-bee1-aa70a04d9709 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Deleted volume successfully. Jul 03 01:18:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9f39ddb3-f9f3-4cdd-9832-557ae8580000 tempest-SnapshotsActionsTest-1822048532 None] Acquiring lock "cinder-f2490309-7c67-40a1-a0de-20c29a868571-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9f39ddb3-f9f3-4cdd-9832-557ae8580000 tempest-SnapshotsActionsTest-1822048532 None] Lock "cinder-f2490309-7c67-40a1-a0de-20c29a868571-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9f39ddb3-f9f3-4cdd-9832-557ae8580000 tempest-SnapshotsActionsTest-1822048532 None] Acquiring lock "cinder-quobyte-efcdbdc2-916c-4048-af18-aff6e9e1e2ed" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:38 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d8302dc5-1488-4b2e-809b-bce7070b80bd Jul 03 01:18:38 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-79e696e8-9f75-4a4d-bee1-aa70a04d9709 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "cinder-e421d182-b8f9-408f-90a1-33427e321de5-delete_volume" released by "delete_volume" :: held 3.898s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44beb620-6a4a-4cf9-bb8f-1a1a1270d69c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9f39ddb3-f9f3-4cdd-9832-557ae8580000 tempest-SnapshotsActionsTest-1822048532 None] Lock "cinder-quobyte-efcdbdc2-916c-4048-af18-aff6e9e1e2ed" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9f39ddb3-f9f3-4cdd-9832-557ae8580000 tempest-SnapshotsActionsTest-1822048532 None] Acquiring lock "cinder-quobyte-f2490309-7c67-40a1-a0de-20c29a868571" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9f39ddb3-f9f3-4cdd-9832-557ae8580000 tempest-SnapshotsActionsTest-1822048532 None] Lock "cinder-quobyte-f2490309-7c67-40a1-a0de-20c29a868571" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:38 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44beb620-6a4a-4cf9-bb8f-1a1a1270d69c Jul 03 01:18:38 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-9f39ddb3-f9f3-4cdd-9832-557ae8580000 tempest-SnapshotsActionsTest-1822048532 None] Deleting offline snapshot f2490309-7c67-40a1-a0de-20c29a868571 of volume efcdbdc2-916c-4048-af18-aff6e9e1e2ed {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:18:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-9f39ddb3-f9f3-4cdd-9832-557ae8580000 tempest-SnapshotsActionsTest-1822048532 None] snapshot_file for this snap is: volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:18:38 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2776f7a5-879d-4bab-852b-e844c180c75b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9f39ddb3-f9f3-4cdd-9832-557ae8580000 tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:38 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 Jul 03 01:18:38 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:38 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-91c8e113-7ac4-4448-a060-f6b3d45b40cd tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d8302dc5-1488-4b2e-809b-bce7070b80bd" returned: 0 in 0.837s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-91c8e113-7ac4-4448-a060-f6b3d45b40cd tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d8302dc5-1488-4b2e-809b-bce7070b80bd {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:38 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44beb620-6a4a-4cf9-bb8f-1a1a1270d69c" returned: 0 in 0.686s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:18:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.101s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2029007830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c0fbbe-591d-440f-becc-a19005cbbec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fedf400d9fd240cfa196e45103ef78f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:36Z,use_quota=True,user_id='ff46fe6e43fb4417a06e960e316f9122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Creating volume 44c0fbbe-591d-440f-becc-a19005cbbec3 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:18:39 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44c0fbbe-591d-440f-becc-a19005cbbec3 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:39 devstack sudo[102294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d8302dc5-1488-4b2e-809b-bce7070b80bd Jul 03 01:18:39 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:39 devstack sudo[102296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44c0fbbe-591d-440f-becc-a19005cbbec3 1073741824 Jul 03 01:18:39 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d56965d-782d-475b-878f-9dc2087ee381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44beb620-6a4a-4cf9-bb8f-1a1a1270d69c', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f2ca44-7854-4f90-8f68-63deedfe6d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:39 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Volume volume-44beb620-6a4a-4cf9-bb8f-1a1a1270d69c (44beb620-6a4a-4cf9-bb8f-1a1a1270d69c): created successfully Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f2ca44-7854-4f90-8f68-63deedfe6d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Flow 'volume_create_manager' (5826ea5f-e634-47ce-8de1-9c92f5d3dc5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:39 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-38999884-f911-452e-ae0c-8b0cc19eb7d0 tempest-CreateVolumesFromImageTest-2067186965 None] Created volume successfully. Jul 03 01:18:39 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9f39ddb3-f9f3-4cdd-9832-557ae8580000 tempest-SnapshotsActionsTest-1822048532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571" returned: 0 in 0.889s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-9f39ddb3-f9f3-4cdd-9832-557ae8580000 tempest-SnapshotsActionsTest-1822048532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d719b8-b02c-4522-b73a-783d1a58237d]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9f39ddb3-f9f3-4cdd-9832-557ae8580000 tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:39 devstack sudo[102301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed Jul 03 01:18:39 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:39 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-91c8e113-7ac4-4448-a060-f6b3d45b40cd tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d8302dc5-1488-4b2e-809b-bce7070b80bd" returned: 0 in 0.794s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-91c8e113-7ac4-4448-a060-f6b3d45b40cd tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "cinder-quobyte-d8302dc5-1488-4b2e-809b-bce7070b80bd" released by "delete_volume" :: held 1.690s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-91c8e113-7ac4-4448-a060-f6b3d45b40cd tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Created reservations ['7bbf27b3-40bb-43f6-af69-4f4a5816278d', '5d299918-84d0-4184-8d3b-10011151eb9d', '7e686bef-bbd6-4130-83fb-44d055e2dd03', 'ae7312c7-c882-42f1-b4c6-e424269f43a5'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-91c8e113-7ac4-4448-a060-f6b3d45b40cd tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-91c8e113-7ac4-4448-a060-f6b3d45b40cd tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-91c8e113-7ac4-4448-a060-f6b3d45b40cd tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:39 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-91c8e113-7ac4-4448-a060-f6b3d45b40cd tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-91c8e113-7ac4-4448-a060-f6b3d45b40cd tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-91c8e113-7ac4-4448-a060-f6b3d45b40cd tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44c0fbbe-591d-440f-becc-a19005cbbec3 1073741824" returned: 0 in 0.915s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:39 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:18:39 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44c0fbbe-591d-440f-becc-a19005cbbec3 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:39 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44c0fbbe-591d-440f-becc-a19005cbbec3 Jul 03 01:18:39 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:40 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9f39ddb3-f9f3-4cdd-9832-557ae8580000 tempest-SnapshotsActionsTest-1822048532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed" returned: 0 in 0.839s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9f39ddb3-f9f3-4cdd-9832-557ae8580000 tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:40 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 Jul 03 01:18:40 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3e41b5d8-cf81-4d3c-b695-5684edcbf899 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "cinder-fde76023-0f1b-4784-ab20-101684dfcf01-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3e41b5d8-cf81-4d3c-b695-5684edcbf899 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "cinder-fde76023-0f1b-4784-ab20-101684dfcf01-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3e41b5d8-cf81-4d3c-b695-5684edcbf899 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "cinder-quobyte-fde76023-0f1b-4784-ab20-101684dfcf01" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3e41b5d8-cf81-4d3c-b695-5684edcbf899 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "cinder-quobyte-fde76023-0f1b-4784-ab20-101684dfcf01" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf0c35c-1d50-45c9-9919-96b95c302e5b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3e41b5d8-cf81-4d3c-b695-5684edcbf899 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fde76023-0f1b-4784-ab20-101684dfcf01 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:40 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fde76023-0f1b-4784-ab20-101684dfcf01 Jul 03 01:18:40 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:40 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-91c8e113-7ac4-4448-a060-f6b3d45b40cd tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.762s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-91c8e113-7ac4-4448-a060-f6b3d45b40cd tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:18:40 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-91c8e113-7ac4-4448-a060-f6b3d45b40cd tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Deleted volume successfully. Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-91c8e113-7ac4-4448-a060-f6b3d45b40cd tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "cinder-d8302dc5-1488-4b2e-809b-bce7070b80bd-delete_volume" released by "delete_volume" :: held 2.719s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:40 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44c0fbbe-591d-440f-becc-a19005cbbec3" returned: 0 in 0.842s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.272s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-829349353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=356c1c5f-0e58-47c5-8b75-4e9682e168e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fedf400d9fd240cfa196e45103ef78f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:36Z,use_quota=True,user_id='ff46fe6e43fb4417a06e960e316f9122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Creating volume 356c1c5f-0e58-47c5-8b75-4e9682e168e1 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:18:40 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-356c1c5f-0e58-47c5-8b75-4e9682e168e1 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:40 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-356c1c5f-0e58-47c5-8b75-4e9682e168e1 1073741824 Jul 03 01:18:40 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cbcf55f-9a51-4cea-a31c-89ffbd84ad65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44c0fbbe-591d-440f-becc-a19005cbbec3', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (183ceceb-e61c-4bee-b513-58b3126c6b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:40 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Volume volume-44c0fbbe-591d-440f-becc-a19005cbbec3 (44c0fbbe-591d-440f-becc-a19005cbbec3): created successfully Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (183ceceb-e61c-4bee-b513-58b3126c6b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Flow 'volume_create_manager' (fde6f7dc-d589-43c2-a869-bba95ab8f961) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:40 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-36a20a62-9e93-4083-b8e5-a58be1c076c9 tempest-CreateVolumesFromImageTest-2067186965 None] Created volume successfully. Jul 03 01:18:41 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9f39ddb3-f9f3-4cdd-9832-557ae8580000 tempest-SnapshotsActionsTest-1822048532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571" returned: 0 in 0.941s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9f39ddb3-f9f3-4cdd-9832-557ae8580000 tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:41 devstack sudo[102326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571 Jul 03 01:18:41 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:41 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3e41b5d8-cf81-4d3c-b695-5684edcbf899 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fde76023-0f1b-4784-ab20-101684dfcf01" returned: 0 in 0.887s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3e41b5d8-cf81-4d3c-b695-5684edcbf899 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fde76023-0f1b-4784-ab20-101684dfcf01 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:41 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fde76023-0f1b-4784-ab20-101684dfcf01 Jul 03 01:18:41 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:41 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-356c1c5f-0e58-47c5-8b75-4e9682e168e1 1073741824" returned: 0 in 0.955s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-356c1c5f-0e58-47c5-8b75-4e9682e168e1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:41 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-356c1c5f-0e58-47c5-8b75-4e9682e168e1 Jul 03 01:18:41 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:41 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9f39ddb3-f9f3-4cdd-9832-557ae8580000 tempest-SnapshotsActionsTest-1822048532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed.f2490309-7c67-40a1-a0de-20c29a868571" returned: 0 in 0.808s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9f39ddb3-f9f3-4cdd-9832-557ae8580000 tempest-SnapshotsActionsTest-1822048532 None] Lock "cinder-quobyte-f2490309-7c67-40a1-a0de-20c29a868571" released by "_delete_snapshot" :: held 3.606s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9f39ddb3-f9f3-4cdd-9832-557ae8580000 tempest-SnapshotsActionsTest-1822048532 None] Lock "cinder-quobyte-efcdbdc2-916c-4048-af18-aff6e9e1e2ed" released by "delete_snapshot" :: held 3.634s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-9f39ddb3-f9f3-4cdd-9832-557ae8580000 tempest-SnapshotsActionsTest-1822048532 None] Created reservations ['d4cb9cf2-0812-4482-b39f-dd75267b66df', '4c0132c8-a1c3-408c-bd6a-4923b0d26114', 'cbb29470-147b-48cc-99b3-63991cfc3935', 'c8cac573-4da9-4ee4-aef7-eff368843ace'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:18:42 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3e41b5d8-cf81-4d3c-b695-5684edcbf899 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fde76023-0f1b-4784-ab20-101684dfcf01" returned: 0 in 0.712s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:42 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9f39ddb3-f9f3-4cdd-9832-557ae8580000 tempest-SnapshotsActionsTest-1822048532 None] Delete snapshot completed successfully. Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3e41b5d8-cf81-4d3c-b695-5684edcbf899 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "cinder-quobyte-fde76023-0f1b-4784-ab20-101684dfcf01" released by "delete_volume" :: held 1.657s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9f39ddb3-f9f3-4cdd-9832-557ae8580000 tempest-SnapshotsActionsTest-1822048532 None] Lock "cinder-f2490309-7c67-40a1-a0de-20c29a868571-delete_snapshot" released by "delete_snapshot" :: held 3.827s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-3e41b5d8-cf81-4d3c-b695-5684edcbf899 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Created reservations ['171b4b2f-4ad6-441f-972d-d3df2b63bec0', '3f42aea6-be27-4261-b6d4-b8451a690457', '8e688e7a-cefa-490d-b8be-294c401c83ea', 'bfff71ab-d693-4e10-8f84-543ba6c35777'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3e41b5d8-cf81-4d3c-b695-5684edcbf899 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3e41b5d8-cf81-4d3c-b695-5684edcbf899 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3e41b5d8-cf81-4d3c-b695-5684edcbf899 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3e41b5d8-cf81-4d3c-b695-5684edcbf899 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3e41b5d8-cf81-4d3c-b695-5684edcbf899 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3e41b5d8-cf81-4d3c-b695-5684edcbf899 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:42 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:18:42 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:42 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-356c1c5f-0e58-47c5-8b75-4e9682e168e1" returned: 0 in 0.719s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.445s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-967446908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fedf400d9fd240cfa196e45103ef78f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:37Z,use_quota=True,user_id='ff46fe6e43fb4417a06e960e316f9122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Creating volume fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:18:42 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:42 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c 1073741824 Jul 03 01:18:42 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b962d7b-e6a7-4b92-b142-b7f96e26748e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-356c1c5f-0e58-47c5-8b75-4e9682e168e1', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f40b545-b54e-4e9f-b916-64f619fc50f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b87c48ee-b09f-468a-8329-1a9125f27669 tempest-SnapshotsActionsTest-1822048532 None] Acquiring lock "cinder-efcdbdc2-916c-4048-af18-aff6e9e1e2ed-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e1a390db-3b5d-4cf9-9f6a-a5b8b802a494 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "cinder-6a2e7c99-ad59-4e5c-a96e-1699f5743b64-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b87c48ee-b09f-468a-8329-1a9125f27669 tempest-SnapshotsActionsTest-1822048532 None] Lock "cinder-efcdbdc2-916c-4048-af18-aff6e9e1e2ed-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:42 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Volume volume-356c1c5f-0e58-47c5-8b75-4e9682e168e1 (356c1c5f-0e58-47c5-8b75-4e9682e168e1): created successfully Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f40b545-b54e-4e9f-b916-64f619fc50f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Flow 'volume_create_manager' (3ddf1f51-a9e8-4ef6-8511-2173b172a28e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e1a390db-3b5d-4cf9-9f6a-a5b8b802a494 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "cinder-6a2e7c99-ad59-4e5c-a96e-1699f5743b64-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:42 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d597f83f-c432-417b-925f-1d35fc26ba8b tempest-CreateVolumesFromImageTest-2067186965 None] Created volume successfully. Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e1a390db-3b5d-4cf9-9f6a-a5b8b802a494 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "cinder-quobyte-6a2e7c99-ad59-4e5c-a96e-1699f5743b64" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b87c48ee-b09f-468a-8329-1a9125f27669 tempest-SnapshotsActionsTest-1822048532 None] Acquiring lock "cinder-quobyte-efcdbdc2-916c-4048-af18-aff6e9e1e2ed" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e1a390db-3b5d-4cf9-9f6a-a5b8b802a494 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "cinder-quobyte-6a2e7c99-ad59-4e5c-a96e-1699f5743b64" acquired by "delete_volume" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b87c48ee-b09f-468a-8329-1a9125f27669 tempest-SnapshotsActionsTest-1822048532 None] Lock "cinder-quobyte-efcdbdc2-916c-4048-af18-aff6e9e1e2ed" acquired by "delete_volume" :: waited 0.049s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c6df9f-fa29-4469-9cd3-830379decbe7]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e1a390db-3b5d-4cf9-9f6a-a5b8b802a494 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a2e7c99-ad59-4e5c-a96e-1699f5743b64 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec3c440-d950-4c99-a9b1-ed789bb252d3]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b87c48ee-b09f-468a-8329-1a9125f27669 tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:42 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a2e7c99-ad59-4e5c-a96e-1699f5743b64 Jul 03 01:18:42 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:43 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3e41b5d8-cf81-4d3c-b695-5684edcbf899 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.779s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:43 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-3e41b5d8-cf81-4d3c-b695-5684edcbf899 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:18:43 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3e41b5d8-cf81-4d3c-b695-5684edcbf899 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Deleted volume successfully. Jul 03 01:18:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3e41b5d8-cf81-4d3c-b695-5684edcbf899 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "cinder-fde76023-0f1b-4784-ab20-101684dfcf01-delete_volume" released by "delete_volume" :: held 2.697s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:43 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed Jul 03 01:18:43 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:43 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e1a390db-3b5d-4cf9-9f6a-a5b8b802a494 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a2e7c99-ad59-4e5c-a96e-1699f5743b64" returned: 0 in 0.975s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e1a390db-3b5d-4cf9-9f6a-a5b8b802a494 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a2e7c99-ad59-4e5c-a96e-1699f5743b64 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:43 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a2e7c99-ad59-4e5c-a96e-1699f5743b64 Jul 03 01:18:43 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:43 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c 1073741824" returned: 0 in 1.353s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:43 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b87c48ee-b09f-468a-8329-1a9125f27669 tempest-SnapshotsActionsTest-1822048532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed" returned: 0 in 1.073s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b87c48ee-b09f-468a-8329-1a9125f27669 tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:43 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed Jul 03 01:18:43 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:44 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c Jul 03 01:18:44 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:44 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e1a390db-3b5d-4cf9-9f6a-a5b8b802a494 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a2e7c99-ad59-4e5c-a96e-1699f5743b64" returned: 0 in 0.769s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e1a390db-3b5d-4cf9-9f6a-a5b8b802a494 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "cinder-quobyte-6a2e7c99-ad59-4e5c-a96e-1699f5743b64" released by "delete_volume" :: held 1.843s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:44 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b87c48ee-b09f-468a-8329-1a9125f27669 tempest-SnapshotsActionsTest-1822048532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-efcdbdc2-916c-4048-af18-aff6e9e1e2ed" returned: 0 in 0.725s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b87c48ee-b09f-468a-8329-1a9125f27669 tempest-SnapshotsActionsTest-1822048532 None] Lock "cinder-quobyte-efcdbdc2-916c-4048-af18-aff6e9e1e2ed" released by "delete_volume" :: held 1.885s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:44 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e1a390db-3b5d-4cf9-9f6a-a5b8b802a494 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Created reservations ['48ddd0d4-3447-467c-aef0-3a6e034e0e01', '8b22d55d-43e0-4b64-8f8b-70b12a7353c6', 'e49c7d1a-02ee-46f5-9097-7470102d0523', 'bf5aed54-bc44-4caa-aab3-71c8530e397a'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:18:44 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c" returned: 0 in 0.825s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] <== create_volume: return (2250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:18:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.254s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:44 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-b87c48ee-b09f-468a-8329-1a9125f27669 tempest-SnapshotsActionsTest-1822048532 None] Created reservations ['dcee0a93-7686-4a56-ade0-6da4adfa2bf8', 'aeda6da7-5f47-4d31-84cc-73cb2478b291', 'c353055a-2b35-4bcf-921f-80c7f6a5e3e3', '9f15f1bd-5e66-437b-934d-64e511f0007c'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:18:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbcb685b-fe6b-401c-a8a5-4b1efcfdb8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9964f14b-83e0-4a00-be69-f062d9c89933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:44 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Volume volume-fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c (fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c): created successfully Jul 03 01:18:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9964f14b-83e0-4a00-be69-f062d9c89933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Flow 'volume_create_manager' (1dc669cc-0065-4a47-9167-d18b9d4fd82e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:44 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f6a2aa7a-db82-430c-9783-b5a09056a1f6 tempest-CreateVolumesFromImageTest-2067186965 None] Created volume successfully. Jul 03 01:18:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e1a390db-3b5d-4cf9-9f6a-a5b8b802a494 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e1a390db-3b5d-4cf9-9f6a-a5b8b802a494 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e1a390db-3b5d-4cf9-9f6a-a5b8b802a494 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e1a390db-3b5d-4cf9-9f6a-a5b8b802a494 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e1a390db-3b5d-4cf9-9f6a-a5b8b802a494 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e1a390db-3b5d-4cf9-9f6a-a5b8b802a494 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:44 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:18:44 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b87c48ee-b09f-468a-8329-1a9125f27669 tempest-SnapshotsActionsTest-1822048532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b87c48ee-b09f-468a-8329-1a9125f27669 tempest-SnapshotsActionsTest-1822048532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b87c48ee-b09f-468a-8329-1a9125f27669 tempest-SnapshotsActionsTest-1822048532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b87c48ee-b09f-468a-8329-1a9125f27669 tempest-SnapshotsActionsTest-1822048532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b87c48ee-b09f-468a-8329-1a9125f27669 tempest-SnapshotsActionsTest-1822048532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b87c48ee-b09f-468a-8329-1a9125f27669 tempest-SnapshotsActionsTest-1822048532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:45 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:18:45 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:45 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e1a390db-3b5d-4cf9-9f6a-a5b8b802a494 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.841s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:45 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-e1a390db-3b5d-4cf9-9f6a-a5b8b802a494 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:18:45 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b87c48ee-b09f-468a-8329-1a9125f27669 tempest-SnapshotsActionsTest-1822048532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.803s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:45 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-b87c48ee-b09f-468a-8329-1a9125f27669 tempest-SnapshotsActionsTest-1822048532 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:18:45 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e1a390db-3b5d-4cf9-9f6a-a5b8b802a494 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Deleted volume successfully. Jul 03 01:18:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e1a390db-3b5d-4cf9-9f6a-a5b8b802a494 tempest-CreateVolumesFromSourceVolumeTest-1472602641 None] Lock "cinder-6a2e7c99-ad59-4e5c-a96e-1699f5743b64-delete_volume" released by "delete_volume" :: held 3.114s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:45 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b87c48ee-b09f-468a-8329-1a9125f27669 tempest-SnapshotsActionsTest-1822048532 None] Deleted volume successfully. Jul 03 01:18:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b87c48ee-b09f-468a-8329-1a9125f27669 tempest-SnapshotsActionsTest-1822048532 None] Lock "cinder-efcdbdc2-916c-4048-af18-aff6e9e1e2ed-delete_volume" released by "delete_volume" :: held 3.182s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e3db679e-5999-4a70-88c4-3025cb491a2b tempest-CreateVolumesFromImageTest-2067186965 None] Acquiring lock "cinder-fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e3db679e-5999-4a70-88c4-3025cb491a2b tempest-CreateVolumesFromImageTest-2067186965 None] Lock "cinder-fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e3db679e-5999-4a70-88c4-3025cb491a2b tempest-CreateVolumesFromImageTest-2067186965 None] Acquiring lock "cinder-quobyte-fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e3db679e-5999-4a70-88c4-3025cb491a2b tempest-CreateVolumesFromImageTest-2067186965 None] Lock "cinder-quobyte-fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c" acquired by "delete_volume" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:46 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f093001-7947-4eca-a864-3f145c53cec4]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3db679e-5999-4a70-88c4-3025cb491a2b tempest-CreateVolumesFromImageTest-2067186965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:46 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c Jul 03 01:18:46 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:47 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3db679e-5999-4a70-88c4-3025cb491a2b tempest-CreateVolumesFromImageTest-2067186965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c" returned: 0 in 1.001s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3db679e-5999-4a70-88c4-3025cb491a2b tempest-CreateVolumesFromImageTest-2067186965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:47 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c Jul 03 01:18:47 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:47 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3db679e-5999-4a70-88c4-3025cb491a2b tempest-CreateVolumesFromImageTest-2067186965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c" returned: 0 in 0.802s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e3db679e-5999-4a70-88c4-3025cb491a2b tempest-CreateVolumesFromImageTest-2067186965 None] Lock "cinder-quobyte-fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c" released by "delete_volume" :: held 1.871s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:47 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e3db679e-5999-4a70-88c4-3025cb491a2b tempest-CreateVolumesFromImageTest-2067186965 None] Created reservations ['56168423-8fc5-44d8-addf-6294d62a46ab', '0a1c6564-7b35-4f35-8de4-9a3a2077e6f5', '5ea3a81b-597d-4665-b31c-81eada8aa350', '28bec95c-54e6-4c3f-a4ca-e557277e55aa'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:18:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e3db679e-5999-4a70-88c4-3025cb491a2b tempest-CreateVolumesFromImageTest-2067186965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e3db679e-5999-4a70-88c4-3025cb491a2b tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e3db679e-5999-4a70-88c4-3025cb491a2b tempest-CreateVolumesFromImageTest-2067186965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e3db679e-5999-4a70-88c4-3025cb491a2b tempest-CreateVolumesFromImageTest-2067186965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e3db679e-5999-4a70-88c4-3025cb491a2b tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3db679e-5999-4a70-88c4-3025cb491a2b tempest-CreateVolumesFromImageTest-2067186965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:48 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:18:48 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-59a009b2-38ce-457b-b058-06038eb3a9c4 tempest-CreateVolumesFromImageTest-2067186965 None] Acquiring lock "cinder-356c1c5f-0e58-47c5-8b75-4e9682e168e1-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-59a009b2-38ce-457b-b058-06038eb3a9c4 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "cinder-356c1c5f-0e58-47c5-8b75-4e9682e168e1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-59a009b2-38ce-457b-b058-06038eb3a9c4 tempest-CreateVolumesFromImageTest-2067186965 None] Acquiring lock "cinder-quobyte-356c1c5f-0e58-47c5-8b75-4e9682e168e1" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-59a009b2-38ce-457b-b058-06038eb3a9c4 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "cinder-quobyte-356c1c5f-0e58-47c5-8b75-4e9682e168e1" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:48 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dcd1ad-bcb2-410f-9c61-354b1ab42293]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-59a009b2-38ce-457b-b058-06038eb3a9c4 tempest-CreateVolumesFromImageTest-2067186965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-356c1c5f-0e58-47c5-8b75-4e9682e168e1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:48 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-356c1c5f-0e58-47c5-8b75-4e9682e168e1 Jul 03 01:18:48 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:48 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3db679e-5999-4a70-88c4-3025cb491a2b tempest-CreateVolumesFromImageTest-2067186965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.875s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:48 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-e3db679e-5999-4a70-88c4-3025cb491a2b tempest-CreateVolumesFromImageTest-2067186965 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:18:48 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e3db679e-5999-4a70-88c4-3025cb491a2b tempest-CreateVolumesFromImageTest-2067186965 None] Deleted volume successfully. Jul 03 01:18:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e3db679e-5999-4a70-88c4-3025cb491a2b tempest-CreateVolumesFromImageTest-2067186965 None] Lock "cinder-fbea1ebb-a4ca-4520-9d3a-f464f6ebdf7c-delete_volume" released by "delete_volume" :: held 3.058s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:49 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-59a009b2-38ce-457b-b058-06038eb3a9c4 tempest-CreateVolumesFromImageTest-2067186965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-356c1c5f-0e58-47c5-8b75-4e9682e168e1" returned: 0 in 0.889s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-59a009b2-38ce-457b-b058-06038eb3a9c4 tempest-CreateVolumesFromImageTest-2067186965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-356c1c5f-0e58-47c5-8b75-4e9682e168e1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:49 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-356c1c5f-0e58-47c5-8b75-4e9682e168e1 Jul 03 01:18:49 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:50 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-59a009b2-38ce-457b-b058-06038eb3a9c4 tempest-CreateVolumesFromImageTest-2067186965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-356c1c5f-0e58-47c5-8b75-4e9682e168e1" returned: 0 in 0.745s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-59a009b2-38ce-457b-b058-06038eb3a9c4 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "cinder-quobyte-356c1c5f-0e58-47c5-8b75-4e9682e168e1" released by "delete_volume" :: held 1.706s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:50 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-59a009b2-38ce-457b-b058-06038eb3a9c4 tempest-CreateVolumesFromImageTest-2067186965 None] Created reservations ['cb0c445e-40bc-44d7-a78e-0aead61d74c6', '34ab96dc-39f5-4f07-af18-9484c4381e37', '67c9b2ca-aee6-4b32-ae6a-69507879f553', 'ece27816-d257-4822-8a11-c3b88684795e'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:18:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-59a009b2-38ce-457b-b058-06038eb3a9c4 tempest-CreateVolumesFromImageTest-2067186965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-59a009b2-38ce-457b-b058-06038eb3a9c4 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-59a009b2-38ce-457b-b058-06038eb3a9c4 tempest-CreateVolumesFromImageTest-2067186965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-59a009b2-38ce-457b-b058-06038eb3a9c4 tempest-CreateVolumesFromImageTest-2067186965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-59a009b2-38ce-457b-b058-06038eb3a9c4 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-59a009b2-38ce-457b-b058-06038eb3a9c4 tempest-CreateVolumesFromImageTest-2067186965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:50 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:18:50 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6bec7dec-8a00-4f42-9188-aae12895d469 tempest-CreateVolumesFromImageTest-2067186965 None] Acquiring lock "cinder-44c0fbbe-591d-440f-becc-a19005cbbec3-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6bec7dec-8a00-4f42-9188-aae12895d469 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "cinder-44c0fbbe-591d-440f-becc-a19005cbbec3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6bec7dec-8a00-4f42-9188-aae12895d469 tempest-CreateVolumesFromImageTest-2067186965 None] Acquiring lock "cinder-quobyte-44c0fbbe-591d-440f-becc-a19005cbbec3" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6bec7dec-8a00-4f42-9188-aae12895d469 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "cinder-quobyte-44c0fbbe-591d-440f-becc-a19005cbbec3" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:50 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3665898-f087-4726-b817-5b7267030f23]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6bec7dec-8a00-4f42-9188-aae12895d469 tempest-CreateVolumesFromImageTest-2067186965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44c0fbbe-591d-440f-becc-a19005cbbec3 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:50 devstack sudo[102406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44c0fbbe-591d-440f-becc-a19005cbbec3 Jul 03 01:18:50 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:51 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-59a009b2-38ce-457b-b058-06038eb3a9c4 tempest-CreateVolumesFromImageTest-2067186965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.888s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:51 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-59a009b2-38ce-457b-b058-06038eb3a9c4 tempest-CreateVolumesFromImageTest-2067186965 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:18:51 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-59a009b2-38ce-457b-b058-06038eb3a9c4 tempest-CreateVolumesFromImageTest-2067186965 None] Deleted volume successfully. Jul 03 01:18:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-59a009b2-38ce-457b-b058-06038eb3a9c4 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "cinder-356c1c5f-0e58-47c5-8b75-4e9682e168e1-delete_volume" released by "delete_volume" :: held 2.836s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:51 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6bec7dec-8a00-4f42-9188-aae12895d469 tempest-CreateVolumesFromImageTest-2067186965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44c0fbbe-591d-440f-becc-a19005cbbec3" returned: 0 in 0.925s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6bec7dec-8a00-4f42-9188-aae12895d469 tempest-CreateVolumesFromImageTest-2067186965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44c0fbbe-591d-440f-becc-a19005cbbec3 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:51 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44c0fbbe-591d-440f-becc-a19005cbbec3 Jul 03 01:18:51 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:51 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:18:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Flow 'volume_create_manager' (cb13d9fb-62ba-42a3-babc-25fc51fd429b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:18:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bed656d-4b4e-4798-badb-1a3ca81946ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bed656d-4b4e-4798-badb-1a3ca81946ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3739d354064040528e8823f1dfd5d09c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:52Z,use_quota=True,user_id='e7a1808971054d9ba482564db8195b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d957af-d8a8-4126-a11c-0e93a0e3fa50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d957af-d8a8-4126-a11c-0e93a0e3fa50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cad7ce3-e629-4eed-9afc-e9b613dfd13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:52 devstack cinder-volume[86772]: DEBUG cinder.image.glance [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Creating Keystone auth plugin from conf {{(pid=86772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 01:18:52 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6bec7dec-8a00-4f42-9188-aae12895d469 tempest-CreateVolumesFromImageTest-2067186965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44c0fbbe-591d-440f-becc-a19005cbbec3" returned: 0 in 0.658s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6bec7dec-8a00-4f42-9188-aae12895d469 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "cinder-quobyte-44c0fbbe-591d-440f-becc-a19005cbbec3" released by "delete_volume" :: held 1.632s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:52 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-6bec7dec-8a00-4f42-9188-aae12895d469 tempest-CreateVolumesFromImageTest-2067186965 None] Created reservations ['55aa34c6-f11a-4cb3-8fba-d9c70de193b3', 'df96c6ec-b732-4bb0-8fcc-a143c495c378', '5d6c1fa4-b7bc-448e-919f-f50f790c907d', 'a23b418b-40d3-42c8-b341-ff37c8716f49'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:18:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cad7ce3-e629-4eed-9afc-e9b613dfd13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c', 'volume_name': 'volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c', 'volume_size': 1, 'image_id': 'cd0302d1-7772-455d-b985-d4d2772e6ec2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd0302d1-7772-455d-b985-d4d2772e6ec2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a282623d54b26e31548e82b96bd60fe5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3739d354064040528e8823f1dfd5d09c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01aee0010fc2905184daebb3c7b62a2364decfbfa552b16f8c29673f5bebc4289d3f0e90ddf0c3e4041f8c68529b5b70f74957eaf1dee75c7d1ec7857681759c', 'id': 'cd0302d1-7772-455d-b985-d4d2772e6ec2', 'created_at': datetime.datetime(2026, 7, 2, 23, 18, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 18, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd0302d1-7772-455d-b985-d4d2772e6ec2/file', 'properties': {}}, 'image_service': }' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab597e8-06d2-419d-952f-01976a884cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab597e8-06d2-419d-952f-01976a884cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:18:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a5d54d-4f4a-44a0-8de1-074b5e428cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:18:52 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Volume ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c', 'volume_size': 1, 'image_id': 'cd0302d1-7772-455d-b985-d4d2772e6ec2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd0302d1-7772-455d-b985-d4d2772e6ec2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a282623d54b26e31548e82b96bd60fe5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3739d354064040528e8823f1dfd5d09c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01aee0010fc2905184daebb3c7b62a2364decfbfa552b16f8c29673f5bebc4289d3f0e90ddf0c3e4041f8c68529b5b70f74957eaf1dee75c7d1ec7857681759c', 'id': 'cd0302d1-7772-455d-b985-d4d2772e6ec2', 'created_at': datetime.datetime(2026, 7, 2, 23, 18, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 18, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd0302d1-7772-455d-b985-d4d2772e6ec2/file', 'properties': {}}, 'image_service': } Jul 03 01:18:52 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Trying to clone ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c from image cd0302d1-7772-455d-b985-d4d2772e6ec2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cd0302d1-7772-455d-b985-d4d2772e6ec2', 'metadata': {}}]). {{(pid=86772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 01:18:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6bec7dec-8a00-4f42-9188-aae12895d469 tempest-CreateVolumesFromImageTest-2067186965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6bec7dec-8a00-4f42-9188-aae12895d469 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6bec7dec-8a00-4f42-9188-aae12895d469 tempest-CreateVolumesFromImageTest-2067186965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6bec7dec-8a00-4f42-9188-aae12895d469 tempest-CreateVolumesFromImageTest-2067186965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6bec7dec-8a00-4f42-9188-aae12895d469 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6bec7dec-8a00-4f42-9188-aae12895d469 tempest-CreateVolumesFromImageTest-2067186965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:52 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:18:52 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:52 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cd0302d1-7772-455d-b985-d4d2772e6ec2_9vqu2htndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 01:18:52 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Image download 0.00 MB at 0.00 MB/s Jul 03 01:18:52 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7119300a-f0c1-49c2-b545-e9fa9c85d409]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0302d1-7772-455d-b985-d4d2772e6ec2_9vqu2htndevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:52 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0302d1-7772-455d-b985-d4d2772e6ec2_9vqu2htndevstack@QuobyteHD Jul 03 01:18:52 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6e5e7f5d-447f-4c45-8748-e0a5ab4e9c4f tempest-CreateVolumesFromImageTest-2067186965 None] Acquiring lock "cinder-44beb620-6a4a-4cf9-bb8f-1a1a1270d69c-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6e5e7f5d-447f-4c45-8748-e0a5ab4e9c4f tempest-CreateVolumesFromImageTest-2067186965 None] Lock "cinder-44beb620-6a4a-4cf9-bb8f-1a1a1270d69c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6e5e7f5d-447f-4c45-8748-e0a5ab4e9c4f tempest-CreateVolumesFromImageTest-2067186965 None] Acquiring lock "cinder-quobyte-44beb620-6a4a-4cf9-bb8f-1a1a1270d69c" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6e5e7f5d-447f-4c45-8748-e0a5ab4e9c4f tempest-CreateVolumesFromImageTest-2067186965 None] Lock "cinder-quobyte-44beb620-6a4a-4cf9-bb8f-1a1a1270d69c" acquired by "delete_volume" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:53 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[80220284-d0bc-40d5-a8fe-e9e5a2139c70]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e5e7f5d-447f-4c45-8748-e0a5ab4e9c4f tempest-CreateVolumesFromImageTest-2067186965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44beb620-6a4a-4cf9-bb8f-1a1a1270d69c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:53 devstack sudo[102421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44beb620-6a4a-4cf9-bb8f-1a1a1270d69c Jul 03 01:18:53 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:53 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6bec7dec-8a00-4f42-9188-aae12895d469 tempest-CreateVolumesFromImageTest-2067186965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.989s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:53 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-6bec7dec-8a00-4f42-9188-aae12895d469 tempest-CreateVolumesFromImageTest-2067186965 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:18:53 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6bec7dec-8a00-4f42-9188-aae12895d469 tempest-CreateVolumesFromImageTest-2067186965 None] Deleted volume successfully. Jul 03 01:18:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6bec7dec-8a00-4f42-9188-aae12895d469 tempest-CreateVolumesFromImageTest-2067186965 None] Lock "cinder-44c0fbbe-591d-440f-becc-a19005cbbec3-delete_volume" released by "delete_volume" :: held 2.931s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:53 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0302d1-7772-455d-b985-d4d2772e6ec2_9vqu2htndevstack@QuobyteHD" returned: 0 in 0.999s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0302d1-7772-455d-b985-d4d2772e6ec2_9vqu2htndevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-16ad3a55-a37e-4677-8d91-b17ced2a47bd req-60bfea7e-5405-42bf-a71b-6212b85baee3 tempest-TestStampPattern-1880660764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-16ad3a55-a37e-4677-8d91-b17ced2a47bd req-60bfea7e-5405-42bf-a71b-6212b85baee3 tempest-TestStampPattern-1880660764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:53 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b126f6e6-d154-408a-aadc-76ef5f764333]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-16ad3a55-a37e-4677-8d91-b17ced2a47bd req-60bfea7e-5405-42bf-a71b-6212b85baee3 tempest-TestStampPattern-1880660764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:53 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0302d1-7772-455d-b985-d4d2772e6ec2_9vqu2htndevstack@QuobyteHD Jul 03 01:18:53 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:53 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 Jul 03 01:18:53 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:54 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e5e7f5d-447f-4c45-8748-e0a5ab4e9c4f tempest-CreateVolumesFromImageTest-2067186965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44beb620-6a4a-4cf9-bb8f-1a1a1270d69c" returned: 0 in 1.068s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e5e7f5d-447f-4c45-8748-e0a5ab4e9c4f tempest-CreateVolumesFromImageTest-2067186965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44beb620-6a4a-4cf9-bb8f-1a1a1270d69c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:54 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44beb620-6a4a-4cf9-bb8f-1a1a1270d69c Jul 03 01:18:54 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:54 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0302d1-7772-455d-b985-d4d2772e6ec2_9vqu2htndevstack@QuobyteHD" returned: 1 in 0.888s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0302d1-7772-455d-b985-d4d2772e6ec2_9vqu2htndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:18:54 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Temporary image cd0302d1-7772-455d-b985-d4d2772e6ec2 is fetched for user e7a1808971054d9ba482564db8195b7f. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 01:18:54 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b640505-daa9-4f36-a2e7-4b6fa00620f7]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0302d1-7772-455d-b985-d4d2772e6ec2_9vqu2htndevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:54 devstack sudo[102448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0302d1-7772-455d-b985-d4d2772e6ec2_9vqu2htndevstack@QuobyteHD Jul 03 01:18:54 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:54 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-16ad3a55-a37e-4677-8d91-b17ced2a47bd req-60bfea7e-5405-42bf-a71b-6212b85baee3 tempest-TestStampPattern-1880660764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017" returned: 0 in 1.065s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-16ad3a55-a37e-4677-8d91-b17ced2a47bd req-60bfea7e-5405-42bf-a71b-6212b85baee3 tempest-TestStampPattern-1880660764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.090s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-16ad3a55-a37e-4677-8d91-b17ced2a47bd req-60bfea7e-5405-42bf-a71b-6212b85baee3 tempest-TestStampPattern-1880660764 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171', 'name': 'volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '413647a2-91e5-409e-8885-c47872d126b3', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:18:54 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-16ad3a55-a37e-4677-8d91-b17ced2a47bd req-60bfea7e-5405-42bf-a71b-6212b85baee3 tempest-TestStampPattern-1880660764 None] attachment_update completed successfully. Jul 03 01:18:54 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e5e7f5d-447f-4c45-8748-e0a5ab4e9c4f tempest-CreateVolumesFromImageTest-2067186965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44beb620-6a4a-4cf9-bb8f-1a1a1270d69c" returned: 0 in 0.743s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6e5e7f5d-447f-4c45-8748-e0a5ab4e9c4f tempest-CreateVolumesFromImageTest-2067186965 None] Lock "cinder-quobyte-44beb620-6a4a-4cf9-bb8f-1a1a1270d69c" released by "delete_volume" :: held 1.903s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:54 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-6e5e7f5d-447f-4c45-8748-e0a5ab4e9c4f tempest-CreateVolumesFromImageTest-2067186965 None] Created reservations ['56612df3-c7b6-44fe-8418-1cd98209d50a', '95319408-0113-4735-a03c-9b2052bfefc2', 'da0075ac-5909-43ed-b315-7bcf787beca3', '0d779f58-0190-4d9b-9893-45c7fb1e6ec2'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:18:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6e5e7f5d-447f-4c45-8748-e0a5ab4e9c4f tempest-CreateVolumesFromImageTest-2067186965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6e5e7f5d-447f-4c45-8748-e0a5ab4e9c4f tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6e5e7f5d-447f-4c45-8748-e0a5ab4e9c4f tempest-CreateVolumesFromImageTest-2067186965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6e5e7f5d-447f-4c45-8748-e0a5ab4e9c4f tempest-CreateVolumesFromImageTest-2067186965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6e5e7f5d-447f-4c45-8748-e0a5ab4e9c4f tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e5e7f5d-447f-4c45-8748-e0a5ab4e9c4f tempest-CreateVolumesFromImageTest-2067186965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:55 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:18:55 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:55 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0302d1-7772-455d-b985-d4d2772e6ec2_9vqu2htndevstack@QuobyteHD" returned: 0 in 0.857s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0302d1-7772-455d-b985-d4d2772e6ec2_9vqu2htndevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5585d780-aa6f-4de6-9721-4b90bb2108be tempest-CreateVolumesFromImageTest-2067186965 None] Acquiring lock "cinder-456187d5-9dd9-4bba-8690-f780dd4f01a0-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5585d780-aa6f-4de6-9721-4b90bb2108be tempest-CreateVolumesFromImageTest-2067186965 None] Lock "cinder-456187d5-9dd9-4bba-8690-f780dd4f01a0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5585d780-aa6f-4de6-9721-4b90bb2108be tempest-CreateVolumesFromImageTest-2067186965 None] Acquiring lock "cinder-quobyte-456187d5-9dd9-4bba-8690-f780dd4f01a0" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:18:55 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0302d1-7772-455d-b985-d4d2772e6ec2_9vqu2htndevstack@QuobyteHD Jul 03 01:18:55 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5585d780-aa6f-4de6-9721-4b90bb2108be tempest-CreateVolumesFromImageTest-2067186965 None] Lock "cinder-quobyte-456187d5-9dd9-4bba-8690-f780dd4f01a0" acquired by "delete_volume" :: waited 0.035s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:18:55 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec7ee51-be56-47c4-a2b4-2d4dfeed3060]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5585d780-aa6f-4de6-9721-4b90bb2108be tempest-CreateVolumesFromImageTest-2067186965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-456187d5-9dd9-4bba-8690-f780dd4f01a0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:55 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-456187d5-9dd9-4bba-8690-f780dd4f01a0 Jul 03 01:18:55 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:55 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e5e7f5d-447f-4c45-8748-e0a5ab4e9c4f tempest-CreateVolumesFromImageTest-2067186965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.852s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:55 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-6e5e7f5d-447f-4c45-8748-e0a5ab4e9c4f tempest-CreateVolumesFromImageTest-2067186965 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:18:55 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6e5e7f5d-447f-4c45-8748-e0a5ab4e9c4f tempest-CreateVolumesFromImageTest-2067186965 None] Deleted volume successfully. Jul 03 01:18:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6e5e7f5d-447f-4c45-8748-e0a5ab4e9c4f tempest-CreateVolumesFromImageTest-2067186965 None] Lock "cinder-44beb620-6a4a-4cf9-bb8f-1a1a1270d69c-delete_volume" released by "delete_volume" :: held 3.047s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:56 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0302d1-7772-455d-b985-d4d2772e6ec2_9vqu2htndevstack@QuobyteHD" returned: 1 in 0.922s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0302d1-7772-455d-b985-d4d2772e6ec2_9vqu2htndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:18:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3739d354064040528e8823f1dfd5d09c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:18:52Z,use_quota=True,user_id='e7a1808971054d9ba482564db8195b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:18:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Creating volume ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:18:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:18:56 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:18:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:56 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c 1073741824 Jul 03 01:18:56 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:56 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5585d780-aa6f-4de6-9721-4b90bb2108be tempest-CreateVolumesFromImageTest-2067186965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-456187d5-9dd9-4bba-8690-f780dd4f01a0" returned: 0 in 1.006s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5585d780-aa6f-4de6-9721-4b90bb2108be tempest-CreateVolumesFromImageTest-2067186965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-456187d5-9dd9-4bba-8690-f780dd4f01a0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:56 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-456187d5-9dd9-4bba-8690-f780dd4f01a0 Jul 03 01:18:56 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:57 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c 1073741824" returned: 0 in 1.045s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:57 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5585d780-aa6f-4de6-9721-4b90bb2108be tempest-CreateVolumesFromImageTest-2067186965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-456187d5-9dd9-4bba-8690-f780dd4f01a0" returned: 0 in 0.788s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5585d780-aa6f-4de6-9721-4b90bb2108be tempest-CreateVolumesFromImageTest-2067186965 None] Lock "cinder-quobyte-456187d5-9dd9-4bba-8690-f780dd4f01a0" released by "delete_volume" :: held 1.855s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:57 devstack sudo[102857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c Jul 03 01:18:57 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:57 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-5585d780-aa6f-4de6-9721-4b90bb2108be tempest-CreateVolumesFromImageTest-2067186965 None] Created reservations ['1b07e3bf-a84b-4e5f-9ec0-c82e05589f85', '1b66d381-59c1-4074-8fbe-1e7d76d86c88', 'cc6440cf-b540-4e5d-8fe5-2a898df7901c', 'fd4585f2-2875-4375-8e57-646f075ee7fa'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:18:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5585d780-aa6f-4de6-9721-4b90bb2108be tempest-CreateVolumesFromImageTest-2067186965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:18:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5585d780-aa6f-4de6-9721-4b90bb2108be tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:18:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5585d780-aa6f-4de6-9721-4b90bb2108be tempest-CreateVolumesFromImageTest-2067186965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:18:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5585d780-aa6f-4de6-9721-4b90bb2108be tempest-CreateVolumesFromImageTest-2067186965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:18:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5585d780-aa6f-4de6-9721-4b90bb2108be tempest-CreateVolumesFromImageTest-2067186965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5585d780-aa6f-4de6-9721-4b90bb2108be tempest-CreateVolumesFromImageTest-2067186965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:57 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:18:57 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:58 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c" returned: 0 in 0.881s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:58 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] <== create_volume: return (2011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:18:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.014s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:18:58 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Attempting download of cd0302d1-7772-455d-b985-d4d2772e6ec2 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd0302d1-7772-455d-b985-d4d2772e6ec2', 'metadata': {}}])) to volume ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 01:18:58 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fc3ed1-5c8d-482f-83b9-dd82b001adea]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:18:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd0302d1-7772-455d-b985-d4d2772e6ec2_02bc5zl6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:58 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5585d780-aa6f-4de6-9721-4b90bb2108be tempest-CreateVolumesFromImageTest-2067186965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.848s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:58 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-5585d780-aa6f-4de6-9721-4b90bb2108be tempest-CreateVolumesFromImageTest-2067186965 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:18:58 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5585d780-aa6f-4de6-9721-4b90bb2108be tempest-CreateVolumesFromImageTest-2067186965 None] Deleted volume successfully. Jul 03 01:18:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5585d780-aa6f-4de6-9721-4b90bb2108be tempest-CreateVolumesFromImageTest-2067186965 None] Lock "cinder-456187d5-9dd9-4bba-8690-f780dd4f01a0-delete_volume" released by "delete_volume" :: held 3.022s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:18:58 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd0302d1-7772-455d-b985-d4d2772e6ec2_02bc5zl6 Jul 03 01:18:58 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:18:59 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Jul 03 01:18:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd0302d1-7772-455d-b985-d4d2772e6ec2_02bc5zl6" returned: 0 in 0.962s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:18:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0302d1-7772-455d-b985-d4d2772e6ec2_02bc5zl6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:18:59 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0302d1-7772-455d-b985-d4d2772e6ec2_02bc5zl6 Jul 03 01:18:59 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:00 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0302d1-7772-455d-b985-d4d2772e6ec2_02bc5zl6" returned: 1 in 0.870s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0302d1-7772-455d-b985-d4d2772e6ec2_02bc5zl6' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:19:00 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc91cb2-fb19-4bbb-8755-3530e2b66a29]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0302d1-7772-455d-b985-d4d2772e6ec2_9vqu2htndevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:00 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0302d1-7772-455d-b985-d4d2772e6ec2_9vqu2htndevstack@QuobyteHD Jul 03 01:19:00 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:01 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0302d1-7772-455d-b985-d4d2772e6ec2_9vqu2htndevstack@QuobyteHD" returned: 0 in 0.878s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0302d1-7772-455d-b985-d4d2772e6ec2_9vqu2htndevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:01 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0302d1-7772-455d-b985-d4d2772e6ec2_9vqu2htndevstack@QuobyteHD Jul 03 01:19:01 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:02 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:19:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Flow 'volume_create_manager' (a998a442-95f7-489a-bfaf-8084ababe1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd1e3e9b-9c2a-4c02-a1dd-9f6c6cc638e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:02 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd1e3e9b-9c2a-4c02-a1dd-9f6c6cc638e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1415657192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6067e012-0d9a-42c5-9c90-ae357cea38fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2bfe4edf51e4bafbe3d181f240123d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:02Z,use_quota=True,user_id='efec2e3971ef4009b708a1ba1cdf11fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd964505-eab7-473f-9815-57a5f962318f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd964505-eab7-473f-9815-57a5f962318f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb774b0-bbf1-4baf-a476-973323a2de9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb774b0-bbf1-4baf-a476-973323a2de9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6067e012-0d9a-42c5-9c90-ae357cea38fa', 'volume_name': 'volume-6067e012-0d9a-42c5-9c90-ae357cea38fa', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e503dce-b034-48d1-ab3d-28f35684f0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e503dce-b034-48d1-ab3d-28f35684f0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (018dfb87-1033-47c4-887e-850fdf52ba62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:02 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Volume 6067e012-0d9a-42c5-9c90-ae357cea38fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6067e012-0d9a-42c5-9c90-ae357cea38fa', 'volume_size': 1} Jul 03 01:19:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1415657192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6067e012-0d9a-42c5-9c90-ae357cea38fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2bfe4edf51e4bafbe3d181f240123d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:02Z,use_quota=True,user_id='efec2e3971ef4009b708a1ba1cdf11fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:19:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Creating volume 6067e012-0d9a-42c5-9c90-ae357cea38fa {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:19:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:19:02 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:19:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0302d1-7772-455d-b985-d4d2772e6ec2_9vqu2htndevstack@QuobyteHD" returned: 1 in 1.100s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0302d1-7772-455d-b985-d4d2772e6ec2_9vqu2htndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:19:02 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] cd0302d1-7772-455d-b985-d4d2772e6ec2 was raw, converting to raw {{(pid=86772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 01:19:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cd0302d1-7772-455d-b985-d4d2772e6ec2_9vqu2htndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:02 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa 1073741824 Jul 03 01:19:02 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:02 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cd0302d1-7772-455d-b985-d4d2772e6ec2_9vqu2htndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c Jul 03 01:19:02 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:03 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cd0302d1-7772-455d-b985-d4d2772e6ec2_9vqu2htndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c" returned: 0 in 1.015s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:03 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cd0302d1-7772-455d-b985-d4d2772e6ec2_9vqu2htndevstack@QuobyteHD, size 0.00 MB, duration 1.02 sec, destination /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:19:03 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 01:19:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:03 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c 1G Jul 03 01:19:03 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:03 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa 1073741824" returned: 0 in 1.173s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:03 devstack sudo[102916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa Jul 03 01:19:03 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:04 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c 1G" returned: 0 in 0.901s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:04 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc97d7d9-a995-40e4-abb9-1796ff7e006c]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:04 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa" returned: 0 in 0.852s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] <== create_volume: return (2093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:19:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.096s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (018dfb87-1033-47c4-887e-850fdf52ba62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6067e012-0d9a-42c5-9c90-ae357cea38fa', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8656ea-3995-4627-9529-c715fdaa8f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:04 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Volume volume-6067e012-0d9a-42c5-9c90-ae357cea38fa (6067e012-0d9a-42c5-9c90-ae357cea38fa): created successfully Jul 03 01:19:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8656ea-3995-4627-9529-c715fdaa8f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Flow 'volume_create_manager' (a998a442-95f7-489a-bfaf-8084ababe1b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:04 devstack sudo[102922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c Jul 03 01:19:04 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:04 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ce4496a3-1af0-4f27-ab66-1cc578877bbf tempest-CreateVolumesFromSnapshotTest-437047707 None] Created volume successfully. Jul 03 01:19:04 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-4cd1386e-05be-4d8c-9965-dbb0bdfa2682 req-13010a33-fde7-4af2-bb2c-d9738cd58a98 tempest-TestStampPattern-1880660764 None] Terminate volume connection completed successfully. Jul 03 01:19:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-4cd1386e-05be-4d8c-9965-dbb0bdfa2682 req-13010a33-fde7-4af2-bb2c-d9738cd58a98 tempest-TestStampPattern-1880660764 None] Deleting attachment 413647a2-91e5-409e-8885-c47872d126b3. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:19:05 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c" returned: 0 in 0.976s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:05 devstack sudo[102954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c Jul 03 01:19:05 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-148898ed-80a7-46f6-8073-2e0150e72255 tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-148898ed-80a7-46f6-8073-2e0150e72255 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-148898ed-80a7-46f6-8073-2e0150e72255 tempest-CreateVolumesFromSnapshotTest-437047707 None] Creating offline snapshot e32ca829-76c1-443f-ae93-bc7d4d3b0bb7 of volume 6067e012-0d9a-42c5-9c90-ae357cea38fa {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:19:05 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8871fc01-fc4d-4593-9a3e-2f9cfa99e856]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-148898ed-80a7-46f6-8073-2e0150e72255 tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:05 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa Jul 03 01:19:05 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:06 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c" returned: 1 in 1.030s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:19:06 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Downloaded image cd0302d1-7772-455d-b985-d4d2772e6ec2 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd0302d1-7772-455d-b985-d4d2772e6ec2', 'metadata': {}}])) to volume ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c successfully. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 01:19:06 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Temporary image cd0302d1-7772-455d-b985-d4d2772e6ec2 for user e7a1808971054d9ba482564db8195b7f is deleted. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 01:19:06 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Marking volume ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c as bootable. {{(pid=86772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 01:19:06 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Copying metadata from image cd0302d1-7772-455d-b985-d4d2772e6ec2 to ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c. {{(pid=86772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 01:19:06 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Creating volume glance metadata for volume ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c backed by image cd0302d1-7772-455d-b985-d4d2772e6ec2 with: {'image_id': 'cd0302d1-7772-455d-b985-d4d2772e6ec2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a282623d54b26e31548e82b96bd60fe5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 01:19:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a5d54d-4f4a-44a0-8de1-074b5e428cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c', 'volume_size': 1, 'image_id': 'cd0302d1-7772-455d-b985-d4d2772e6ec2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd0302d1-7772-455d-b985-d4d2772e6ec2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a282623d54b26e31548e82b96bd60fe5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3739d354064040528e8823f1dfd5d09c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01aee0010fc2905184daebb3c7b62a2364decfbfa552b16f8c29673f5bebc4289d3f0e90ddf0c3e4041f8c68529b5b70f74957eaf1dee75c7d1ec7857681759c', 'id': 'cd0302d1-7772-455d-b985-d4d2772e6ec2', 'created_at': datetime.datetime(2026, 7, 2, 23, 18, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 18, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd0302d1-7772-455d-b985-d4d2772e6ec2/file', 'properties': {}}, 'image_service': }' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486756a7-5069-4b29-80fe-f7c7a1c2a13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:06 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Volume volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c (ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c): created successfully Jul 03 01:19:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486756a7-5069-4b29-80fe-f7c7a1c2a13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Flow 'volume_create_manager' (cb13d9fb-62ba-42a3-babc-25fc51fd429b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:06 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f69b6c7f-ed36-4e4f-aad2-52f27f72f37d tempest-VolumeImageDependencyTests-457725362 None] Created volume successfully. Jul 03 01:19:06 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-148898ed-80a7-46f6-8073-2e0150e72255 tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa" returned: 0 in 0.902s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-148898ed-80a7-46f6-8073-2e0150e72255 tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.e32ca829-76c1-443f-ae93-bc7d4d3b0bb7 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:06 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.e32ca829-76c1-443f-ae93-bc7d4d3b0bb7 1G Jul 03 01:19:06 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ea14ebaa-ef88-4fde-8cd8-a96ec5ccb025 tempest-TestStampPattern-1880660764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ae47298e-ff31-42bb-bd98-bf994bdfeca1 tempest-VolumeImageDependencyTests-457725362 None] Acquiring lock "cinder-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ae47298e-ff31-42bb-bd98-bf994bdfeca1 tempest-VolumeImageDependencyTests-457725362 None] Lock "cinder-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ae47298e-ff31-42bb-bd98-bf994bdfeca1 tempest-VolumeImageDependencyTests-457725362 None] Acquiring lock "cinder-quobyte-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ae47298e-ff31-42bb-bd98-bf994bdfeca1 tempest-VolumeImageDependencyTests-457725362 None] Lock "cinder-quobyte-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c" acquired by "delete_volume" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:07 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b6117d-485c-47f5-95c6-4aef0dc090cf]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ae47298e-ff31-42bb-bd98-bf994bdfeca1 tempest-VolumeImageDependencyTests-457725362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:07 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c Jul 03 01:19:07 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:07 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-148898ed-80a7-46f6-8073-2e0150e72255 tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.e32ca829-76c1-443f-ae93-bc7d4d3b0bb7 1G" returned: 0 in 1.010s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-148898ed-80a7-46f6-8073-2e0150e72255 tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6067e012-0d9a-42c5-9c90-ae357cea38fa -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.e32ca829-76c1-443f-ae93-bc7d4d3b0bb7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:07 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6067e012-0d9a-42c5-9c90-ae357cea38fa -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.e32ca829-76c1-443f-ae93-bc7d4d3b0bb7 Jul 03 01:19:07 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:08 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ae47298e-ff31-42bb-bd98-bf994bdfeca1 tempest-VolumeImageDependencyTests-457725362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c" returned: 0 in 0.878s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ae47298e-ff31-42bb-bd98-bf994bdfeca1 tempest-VolumeImageDependencyTests-457725362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:08 devstack sudo[102987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c Jul 03 01:19:08 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:08 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-148898ed-80a7-46f6-8073-2e0150e72255 tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6067e012-0d9a-42c5-9c90-ae357cea38fa -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.e32ca829-76c1-443f-ae93-bc7d4d3b0bb7" returned: 0 in 0.920s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:08 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-148898ed-80a7-46f6-8073-2e0150e72255 tempest-CreateVolumesFromSnapshotTest-437047707 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.e32ca829-76c1-443f-ae93-bc7d4d3b0bb7 is being set with open permissions: ugo+rw Jul 03 01:19:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-148898ed-80a7-46f6-8073-2e0150e72255 tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.e32ca829-76c1-443f-ae93-bc7d4d3b0bb7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:08 devstack sudo[102990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.e32ca829-76c1-443f-ae93-bc7d4d3b0bb7 Jul 03 01:19:08 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:08 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:19:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Flow 'volume_create_manager' (518692df-d021-45d3-82c8-96cdb770b309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55dc67b2-8928-4541-a441-3c83922c68f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55dc67b2-8928-4541-a441-3c83922c68f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-376140271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b410be-62fd-4867-9dcc-0489ee1907a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b82d21c2f094f2cbf73afcd974c488a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:09Z,use_quota=True,user_id='23f4fe846c8b4af49db739c90fbbcf77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67081fea-d3df-4fee-b9ab-17d64ccfd8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67081fea-d3df-4fee-b9ab-17d64ccfd8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d21bbc5-83c1-4794-8f8b-fe5828497f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d21bbc5-83c1-4794-8f8b-fe5828497f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4b410be-62fd-4867-9dcc-0489ee1907a7', 'volume_name': 'volume-d4b410be-62fd-4867-9dcc-0489ee1907a7', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8256590d-be42-4d1d-b6da-f0d1646aa856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8256590d-be42-4d1d-b6da-f0d1646aa856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89849a4d-4256-4b73-880b-1282cfc74ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:08 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Volume d4b410be-62fd-4867-9dcc-0489ee1907a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4b410be-62fd-4867-9dcc-0489ee1907a7', 'volume_size': 1} Jul 03 01:19:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:09 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ae47298e-ff31-42bb-bd98-bf994bdfeca1 tempest-VolumeImageDependencyTests-457725362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c" returned: 1 in 0.801s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ae47298e-ff31-42bb-bd98-bf994bdfeca1 tempest-VolumeImageDependencyTests-457725362 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:19:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ae47298e-ff31-42bb-bd98-bf994bdfeca1 tempest-VolumeImageDependencyTests-457725362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:09 devstack sudo[102996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c Jul 03 01:19:09 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:09 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-148898ed-80a7-46f6-8073-2e0150e72255 tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.e32ca829-76c1-443f-ae93-bc7d4d3b0bb7" returned: 0 in 0.698s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-148898ed-80a7-46f6-8073-2e0150e72255 tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:09 devstack sudo[102998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.info Jul 03 01:19:09 devstack sudo[102998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:09 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ae47298e-ff31-42bb-bd98-bf994bdfeca1 tempest-VolumeImageDependencyTests-457725362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c" returned: 0 in 0.665s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ae47298e-ff31-42bb-bd98-bf994bdfeca1 tempest-VolumeImageDependencyTests-457725362 None] Lock "cinder-quobyte-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c" released by "delete_volume" :: held 2.415s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:09 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-ae47298e-ff31-42bb-bd98-bf994bdfeca1 tempest-VolumeImageDependencyTests-457725362 None] Created reservations ['e1e1bac8-2e90-4844-9084-7c25a81077e3', '69de1a7d-7c5c-43e0-b6e5-10fd9e58334c', '83829428-3721-47d7-a6c0-fbb1c2a143ad', 'd7ac0dda-eb55-4b68-8cf0-71420a064958'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:19:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ae47298e-ff31-42bb-bd98-bf994bdfeca1 tempest-VolumeImageDependencyTests-457725362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ae47298e-ff31-42bb-bd98-bf994bdfeca1 tempest-VolumeImageDependencyTests-457725362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ae47298e-ff31-42bb-bd98-bf994bdfeca1 tempest-VolumeImageDependencyTests-457725362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ae47298e-ff31-42bb-bd98-bf994bdfeca1 tempest-VolumeImageDependencyTests-457725362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ae47298e-ff31-42bb-bd98-bf994bdfeca1 tempest-VolumeImageDependencyTests-457725362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ae47298e-ff31-42bb-bd98-bf994bdfeca1 tempest-VolumeImageDependencyTests-457725362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:10 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:19:10 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:10 devstack sudo[102998]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-148898ed-80a7-46f6-8073-2e0150e72255 tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.info" returned: 0 in 0.676s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:10 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-148898ed-80a7-46f6-8073-2e0150e72255 tempest-CreateVolumesFromSnapshotTest-437047707 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.info is being set with open permissions: ugo+rw Jul 03 01:19:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-148898ed-80a7-46f6-8073-2e0150e72255 tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:10 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.info Jul 03 01:19:10 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:10 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ae47298e-ff31-42bb-bd98-bf994bdfeca1 tempest-VolumeImageDependencyTests-457725362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.675s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:10 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-ae47298e-ff31-42bb-bd98-bf994bdfeca1 tempest-VolumeImageDependencyTests-457725362 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:19:10 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ae47298e-ff31-42bb-bd98-bf994bdfeca1 tempest-VolumeImageDependencyTests-457725362 None] Deleted volume successfully. Jul 03 01:19:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ae47298e-ff31-42bb-bd98-bf994bdfeca1 tempest-VolumeImageDependencyTests-457725362 None] Lock "cinder-ca1fb520-65e2-4a69-9fc9-aec7db4e8e4c-delete_volume" released by "delete_volume" :: held 3.338s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:10 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-148898ed-80a7-46f6-8073-2e0150e72255 tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.info" returned: 0 in 0.718s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-148898ed-80a7-46f6-8073-2e0150e72255 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.032s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ea14ebaa-ef88-4fde-8cd8-a96ec5ccb025 tempest-TestStampPattern-1880660764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.607s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-ea14ebaa-ef88-4fde-8cd8-a96ec5ccb025 tempest-TestStampPattern-1880660764 None] Creating offline snapshot f4837ae5-964f-44b1-9d8b-e2c659713db8 of volume f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:19:10 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-148898ed-80a7-46f6-8073-2e0150e72255 tempest-CreateVolumesFromSnapshotTest-437047707 None] Create snapshot completed successfully Jul 03 01:19:10 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b604ce1-d14b-49fd-8cb2-4b3084fe18f2]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea14ebaa-ef88-4fde-8cd8-a96ec5ccb025 tempest-TestStampPattern-1880660764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:11 devstack sudo[103009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 Jul 03 01:19:11 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:11 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea14ebaa-ef88-4fde-8cd8-a96ec5ccb025 tempest-TestStampPattern-1880660764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017" returned: 0 in 0.857s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea14ebaa-ef88-4fde-8cd8-a96ec5ccb025 tempest-TestStampPattern-1880660764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.f4837ae5-964f-44b1-9d8b-e2c659713db8 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:11 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.f4837ae5-964f-44b1-9d8b-e2c659713db8 1G Jul 03 01:19:11 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:12 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:19:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Flow 'volume_create_manager' (4fda5abf-c6c6-4a90-ad8b-877fe7bbb537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15ff5eba-f439-4631-82a4-10272969e213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15ff5eba-f439-4631-82a4-10272969e213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1727306882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2bfe4edf51e4bafbe3d181f240123d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:13Z,use_quota=True,user_id='efec2e3971ef4009b708a1ba1cdf11fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1239fdf3-0e03-462f-b27b-bb3e7b7fd34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1239fdf3-0e03-462f-b27b-bb3e7b7fd34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0227bb29-9842-427e-ba75-fcda6a54f242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0227bb29-9842-427e-ba75-fcda6a54f242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f', 'volume_name': 'volume-23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a3ed37-f4a1-4af1-a10c-26fa899a0509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a3ed37-f4a1-4af1-a10c-26fa899a0509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b451bc7f-3d79-4bb1-b2c2-a0988911dd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:12 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Volume 23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f', 'volume_size': 1} Jul 03 01:19:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:19:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:12 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:19:12 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:12 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea14ebaa-ef88-4fde-8cd8-a96ec5ccb025 tempest-TestStampPattern-1880660764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.f4837ae5-964f-44b1-9d8b-e2c659713db8 1G" returned: 0 in 1.210s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea14ebaa-ef88-4fde-8cd8-a96ec5ccb025 tempest-TestStampPattern-1880660764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.f4837ae5-964f-44b1-9d8b-e2c659713db8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Flow 'volume_create_manager' (4fe642db-2cf3-44ce-bc9d-655ebdeffffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:13 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.f4837ae5-964f-44b1-9d8b-e2c659713db8 Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03938a46-5e33-4878-a6b9-01e7b092be4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:13 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03938a46-5e33-4878-a6b9-01e7b092be4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1883554344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a4b3fe-64a8-44a9-9970-d60a1e0d86fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2bfe4edf51e4bafbe3d181f240123d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:13Z,use_quota=True,user_id='efec2e3971ef4009b708a1ba1cdf11fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4acc75f-9082-45e9-a41c-d777c6b91425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4acc75f-9082-45e9-a41c-d777c6b91425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49eb9493-fb62-411b-af36-8ca48857a742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49eb9493-fb62-411b-af36-8ca48857a742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54a4b3fe-64a8-44a9-9970-d60a1e0d86fe', 'volume_name': 'volume-54a4b3fe-64a8-44a9-9970-d60a1e0d86fe', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd90edac-d65c-4ada-9c68-675bb44765ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd90edac-d65c-4ada-9c68-675bb44765ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d987665-09f9-4b61-98df-f7e626328497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:13 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Volume 54a4b3fe-64a8-44a9-9970-d60a1e0d86fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54a4b3fe-64a8-44a9-9970-d60a1e0d86fe', 'volume_size': 1} Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Flow 'volume_create_manager' (c72201ae-a12a-43e6-b254-598156e8a53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62af0f49-93a9-4b6b-b180-c4fd5a808f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62af0f49-93a9-4b6b-b180-c4fd5a808f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1447246817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2864f7c-e768-43ae-b64b-6b1be706f12c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2bfe4edf51e4bafbe3d181f240123d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:14Z,use_quota=True,user_id='efec2e3971ef4009b708a1ba1cdf11fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b2f3fa-1e45-4f03-941e-89badb149f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b2f3fa-1e45-4f03-941e-89badb149f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b149edf5-f34c-4e6b-8c79-bf5085db01c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b149edf5-f34c-4e6b-8c79-bf5085db01c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2864f7c-e768-43ae-b64b-6b1be706f12c', 'volume_name': 'volume-e2864f7c-e768-43ae-b64b-6b1be706f12c', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c1d47c8-4daa-4b69-9c5d-469e21c2b8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c1d47c8-4daa-4b69-9c5d-469e21c2b8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (743996bb-c5ae-474c-a613-3358bd9b5bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:13 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Volume e2864f7c-e768-43ae-b64b-6b1be706f12c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2864f7c-e768-43ae-b64b-6b1be706f12c', 'volume_size': 1} Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:13 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.912s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 29 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:19:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:19:14 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea14ebaa-ef88-4fde-8cd8-a96ec5ccb025 tempest-TestStampPattern-1880660764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.f4837ae5-964f-44b1-9d8b-e2c659713db8" returned: 0 in 1.028s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:14 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-ea14ebaa-ef88-4fde-8cd8-a96ec5ccb025 tempest-TestStampPattern-1880660764 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.f4837ae5-964f-44b1-9d8b-e2c659713db8 is being set with open permissions: ugo+rw Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea14ebaa-ef88-4fde-8cd8-a96ec5ccb025 tempest-TestStampPattern-1880660764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.f4837ae5-964f-44b1-9d8b-e2c659713db8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:14 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.f4837ae5-964f-44b1-9d8b-e2c659713db8 Jul 03 01:19:14 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Flow 'volume_create_manager' (935f4117-91d0-4aee-84fb-6dbf331a65d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a096ef39-cc62-443c-8e50-90c61756750f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a096ef39-cc62-443c-8e50-90c61756750f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-746137680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68fb93c8-ee31-4de7-9751-14d6bc2f34b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2bfe4edf51e4bafbe3d181f240123d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:14Z,use_quota=True,user_id='efec2e3971ef4009b708a1ba1cdf11fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (800bbe22-68a8-46ee-8b70-2d0ee4f1e152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (800bbe22-68a8-46ee-8b70-2d0ee4f1e152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9c5234-ed34-45b1-a235-c9c97bbd5886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9c5234-ed34-45b1-a235-c9c97bbd5886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68fb93c8-ee31-4de7-9751-14d6bc2f34b2', 'volume_name': 'volume-68fb93c8-ee31-4de7-9751-14d6bc2f34b2', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aea720b-5cf0-4a86-be07-69f6c5fc589c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aea720b-5cf0-4a86-be07-69f6c5fc589c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fded5eb-a10d-408e-94ab-2a821198e008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:14 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Volume 68fb93c8-ee31-4de7-9751-14d6bc2f34b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68fb93c8-ee31-4de7-9751-14d6bc2f34b2', 'volume_size': 1} Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Flow 'volume_create_manager' (0034d05d-d074-4021-8bd0-07e23ee97875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d89666-9787-4459-8d6f-62906baa8cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d89666-9787-4459-8d6f-62906baa8cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-190175713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6bca20c-1078-4486-bb45-3b66ce3ccad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2bfe4edf51e4bafbe3d181f240123d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:15Z,use_quota=True,user_id='efec2e3971ef4009b708a1ba1cdf11fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f43fba-5b9e-4e7a-aca1-2e270e9046e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f43fba-5b9e-4e7a-aca1-2e270e9046e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e899484-5b85-4dad-8f11-3a8e01ca5034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e899484-5b85-4dad-8f11-3a8e01ca5034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6bca20c-1078-4486-bb45-3b66ce3ccad0', 'volume_name': 'volume-e6bca20c-1078-4486-bb45-3b66ce3ccad0', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ed12af-e247-4251-a210-ff8fc9380738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ed12af-e247-4251-a210-ff8fc9380738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5542ccde-f3f5-469f-ac47-8e0fc03f0123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:14 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Volume e6bca20c-1078-4486-bb45-3b66ce3ccad0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6bca20c-1078-4486-bb45-3b66ce3ccad0', 'volume_size': 1} Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:14 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea14ebaa-ef88-4fde-8cd8-a96ec5ccb025 tempest-TestStampPattern-1880660764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.f4837ae5-964f-44b1-9d8b-e2c659713db8" returned: 0 in 0.847s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea14ebaa-ef88-4fde-8cd8-a96ec5ccb025 tempest-TestStampPattern-1880660764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:14 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.info Jul 03 01:19:14 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:15 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea14ebaa-ef88-4fde-8cd8-a96ec5ccb025 tempest-TestStampPattern-1880660764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.info" returned: 0 in 0.735s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:15 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-ea14ebaa-ef88-4fde-8cd8-a96ec5ccb025 tempest-TestStampPattern-1880660764 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.info is being set with open permissions: ugo+rw Jul 03 01:19:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea14ebaa-ef88-4fde-8cd8-a96ec5ccb025 tempest-TestStampPattern-1880660764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:15 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.info Jul 03 01:19:15 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:16 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea14ebaa-ef88-4fde-8cd8-a96ec5ccb025 tempest-TestStampPattern-1880660764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.info" returned: 0 in 0.749s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ea14ebaa-ef88-4fde-8cd8-a96ec5ccb025 tempest-TestStampPattern-1880660764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.543s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.580s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-376140271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b410be-62fd-4867-9dcc-0489ee1907a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b82d21c2f094f2cbf73afcd974c488a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:09Z,use_quota=True,user_id='23f4fe846c8b4af49db739c90fbbcf77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:19:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Creating volume d4b410be-62fd-4867-9dcc-0489ee1907a7 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:19:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:19:16 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:19:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:16 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=128,cinder:UPDATE=162,cinder:DELETE=16,cinder:INSERT=37 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:19:16 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7 1073741824 Jul 03 01:19:16 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:16 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:INSERT=46,cinder:UPDATE=165,cinder:SELECT=119,cinder:DELETE=11 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:19:16 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ea14ebaa-ef88-4fde-8cd8-a96ec5ccb025 tempest-TestStampPattern-1880660764 None] Create snapshot completed successfully Jul 03 01:19:17 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7 1073741824" returned: 0 in 1.079s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:17 devstack sudo[103081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7 Jul 03 01:19:17 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:18 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7" returned: 0 in 0.773s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:19:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.908s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.640s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1727306882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2bfe4edf51e4bafbe3d181f240123d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:13Z,use_quota=True,user_id='efec2e3971ef4009b708a1ba1cdf11fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:19:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Creating volume 23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:19:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:19:18 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:19:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89849a4d-4256-4b73-880b-1282cfc74ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4b410be-62fd-4867-9dcc-0489ee1907a7', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:18 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f 1073741824 Jul 03 01:19:18 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f207b7a-0c96-4b93-9894-29988a4772be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:18 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Volume volume-d4b410be-62fd-4867-9dcc-0489ee1907a7 (d4b410be-62fd-4867-9dcc-0489ee1907a7): created successfully Jul 03 01:19:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f207b7a-0c96-4b93-9894-29988a4772be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Flow 'volume_create_manager' (518692df-d021-45d3-82c8-96cdb770b309) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:18 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-42872da1-62c5-43e7-b4fc-8a6f7a22800c tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Created volume successfully. Jul 03 01:19:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0e51ebac-4b65-4d9d-9553-36d0b9aff0e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:19 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f 1073741824" returned: 0 in 1.024s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:19 devstack sudo[103091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f Jul 03 01:19:19 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:20 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f" returned: 0 in 0.732s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:19:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.028s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1883554344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a4b3fe-64a8-44a9-9970-d60a1e0d86fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2bfe4edf51e4bafbe3d181f240123d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:13Z,use_quota=True,user_id='efec2e3971ef4009b708a1ba1cdf11fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:19:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Creating volume 54a4b3fe-64a8-44a9-9970-d60a1e0d86fe {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:19:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:19:20 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:19:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54a4b3fe-64a8-44a9-9970-d60a1e0d86fe 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:20 devstack sudo[103094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54a4b3fe-64a8-44a9-9970-d60a1e0d86fe 1073741824 Jul 03 01:19:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b451bc7f-3d79-4bb1-b2c2-a0988911dd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:20 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893ae1f0-81ab-4d11-9f99-0b20963057c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:20 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Volume volume-23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f (23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f): created successfully Jul 03 01:19:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893ae1f0-81ab-4d11-9f99-0b20963057c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Flow 'volume_create_manager' (4fda5abf-c6c6-4a90-ad8b-877fe7bbb537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:20 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-fec64c04-2105-40c6-a63f-1e0aeeef297f tempest-CreateVolumesFromSnapshotTest-437047707 None] Created volume successfully. Jul 03 01:19:21 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54a4b3fe-64a8-44a9-9970-d60a1e0d86fe 1073741824" returned: 0 in 1.010s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54a4b3fe-64a8-44a9-9970-d60a1e0d86fe {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:21 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54a4b3fe-64a8-44a9-9970-d60a1e0d86fe Jul 03 01:19:21 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:22 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54a4b3fe-64a8-44a9-9970-d60a1e0d86fe" returned: 0 in 0.798s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:19:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.221s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1447246817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2864f7c-e768-43ae-b64b-6b1be706f12c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2bfe4edf51e4bafbe3d181f240123d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:14Z,use_quota=True,user_id='efec2e3971ef4009b708a1ba1cdf11fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:19:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Creating volume e2864f7c-e768-43ae-b64b-6b1be706f12c {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:19:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:19:22 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:19:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e2864f7c-e768-43ae-b64b-6b1be706f12c 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:22 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e2864f7c-e768-43ae-b64b-6b1be706f12c 1073741824 Jul 03 01:19:22 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d987665-09f9-4b61-98df-f7e626328497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54a4b3fe-64a8-44a9-9970-d60a1e0d86fe', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7e196fa-b104-47fd-9913-24c73c6b3877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:22 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Volume volume-54a4b3fe-64a8-44a9-9970-d60a1e0d86fe (54a4b3fe-64a8-44a9-9970-d60a1e0d86fe): created successfully Jul 03 01:19:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7e196fa-b104-47fd-9913-24c73c6b3877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Flow 'volume_create_manager' (4fe642db-2cf3-44ce-bc9d-655ebdeffffc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:22 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-957d7d30-c851-4cc0-9635-f622363dddd7 tempest-CreateVolumesFromSnapshotTest-437047707 None] Created volume successfully. Jul 03 01:19:22 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e2864f7c-e768-43ae-b64b-6b1be706f12c 1073741824" returned: 0 in 0.901s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e2864f7c-e768-43ae-b64b-6b1be706f12c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:22 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e2864f7c-e768-43ae-b64b-6b1be706f12c Jul 03 01:19:22 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:23 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e2864f7c-e768-43ae-b64b-6b1be706f12c" returned: 0 in 0.783s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:19:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.483s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-746137680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68fb93c8-ee31-4de7-9751-14d6bc2f34b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2bfe4edf51e4bafbe3d181f240123d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:14Z,use_quota=True,user_id='efec2e3971ef4009b708a1ba1cdf11fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:19:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Creating volume 68fb93c8-ee31-4de7-9751-14d6bc2f34b2 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:19:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:19:23 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:19:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-68fb93c8-ee31-4de7-9751-14d6bc2f34b2 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (743996bb-c5ae-474c-a613-3358bd9b5bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2864f7c-e768-43ae-b64b-6b1be706f12c', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f6adcd2-451f-4523-91b6-358d20bf6c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:23 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-68fb93c8-ee31-4de7-9751-14d6bc2f34b2 1073741824 Jul 03 01:19:23 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:23 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Volume volume-e2864f7c-e768-43ae-b64b-6b1be706f12c (e2864f7c-e768-43ae-b64b-6b1be706f12c): created successfully Jul 03 01:19:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f6adcd2-451f-4523-91b6-358d20bf6c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Flow 'volume_create_manager' (c72201ae-a12a-43e6-b254-598156e8a53c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:23 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-72f4ae94-d75b-4822-b8c2-a98be73ae240 tempest-CreateVolumesFromSnapshotTest-437047707 None] Created volume successfully. Jul 03 01:19:24 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-68fb93c8-ee31-4de7-9751-14d6bc2f34b2 1073741824" returned: 0 in 1.086s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-68fb93c8-ee31-4de7-9751-14d6bc2f34b2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:24 devstack sudo[103163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-68fb93c8-ee31-4de7-9751-14d6bc2f34b2 Jul 03 01:19:24 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:25 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-68fb93c8-ee31-4de7-9751-14d6bc2f34b2" returned: 0 in 0.760s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:19:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.901s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.018s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-190175713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6bca20c-1078-4486-bb45-3b66ce3ccad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2bfe4edf51e4bafbe3d181f240123d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:15Z,use_quota=True,user_id='efec2e3971ef4009b708a1ba1cdf11fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:19:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Creating volume e6bca20c-1078-4486-bb45-3b66ce3ccad0 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:19:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:19:25 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:19:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6bca20c-1078-4486-bb45-3b66ce3ccad0 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:25 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6bca20c-1078-4486-bb45-3b66ce3ccad0 1073741824 Jul 03 01:19:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fded5eb-a10d-408e-94ab-2a821198e008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68fb93c8-ee31-4de7-9751-14d6bc2f34b2', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:25 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (423ef81f-52eb-4ce3-abc7-b730dd1ff181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:25 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Volume volume-68fb93c8-ee31-4de7-9751-14d6bc2f34b2 (68fb93c8-ee31-4de7-9751-14d6bc2f34b2): created successfully Jul 03 01:19:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (423ef81f-52eb-4ce3-abc7-b730dd1ff181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Flow 'volume_create_manager' (935f4117-91d0-4aee-84fb-6dbf331a65d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:25 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-383bddbe-61f4-45a7-ab85-480b6a24bb94 tempest-CreateVolumesFromSnapshotTest-437047707 None] Created volume successfully. Jul 03 01:19:26 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6bca20c-1078-4486-bb45-3b66ce3ccad0 1073741824" returned: 0 in 1.202s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6bca20c-1078-4486-bb45-3b66ce3ccad0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:26 devstack sudo[103172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6bca20c-1078-4486-bb45-3b66ce3ccad0 Jul 03 01:19:26 devstack sudo[103172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:27 devstack sudo[103172]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6bca20c-1078-4486-bb45-3b66ce3ccad0" returned: 0 in 0.685s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] <== create_volume: return (1933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:19:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.938s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0e51ebac-4b65-4d9d-9553-36d0b9aff0e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.791s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-0e51ebac-4b65-4d9d-9553-36d0b9aff0e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Creating offline snapshot 5d8de84a-d59d-43fc-9d85-8efdd43ac99c of volume d4b410be-62fd-4867-9dcc-0489ee1907a7 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:19:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5542ccde-f3f5-469f-ac47-8e0fc03f0123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6bca20c-1078-4486-bb45-3b66ce3ccad0', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a89dc47-6c4a-47a3-82d0-57b07eadd1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:27 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc0e2b4-bfcb-4c66-a474-482ebb2033da]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0e51ebac-4b65-4d9d-9553-36d0b9aff0e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:27 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Volume volume-e6bca20c-1078-4486-bb45-3b66ce3ccad0 (e6bca20c-1078-4486-bb45-3b66ce3ccad0): created successfully Jul 03 01:19:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a89dc47-6c4a-47a3-82d0-57b07eadd1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Flow 'volume_create_manager' (0034d05d-d074-4021-8bd0-07e23ee97875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:27 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e3a781e9-2a48-48c4-8f72-65be5e038b7e tempest-CreateVolumesFromSnapshotTest-437047707 None] Created volume successfully. Jul 03 01:19:27 devstack sudo[103175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7 Jul 03 01:19:27 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-15cdf018-a0d8-4122-804d-15ba5a6da4bb tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "cinder-e6bca20c-1078-4486-bb45-3b66ce3ccad0-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-15cdf018-a0d8-4122-804d-15ba5a6da4bb tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-e6bca20c-1078-4486-bb45-3b66ce3ccad0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-15cdf018-a0d8-4122-804d-15ba5a6da4bb tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "cinder-quobyte-e6bca20c-1078-4486-bb45-3b66ce3ccad0" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-15cdf018-a0d8-4122-804d-15ba5a6da4bb tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-quobyte-e6bca20c-1078-4486-bb45-3b66ce3ccad0" acquired by "delete_volume" :: waited 0.041s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:28 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b25a56-ddd1-47e1-b9a8-639bf1fac2d0]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-15cdf018-a0d8-4122-804d-15ba5a6da4bb tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6bca20c-1078-4486-bb45-3b66ce3ccad0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:28 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:19:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Flow 'volume_create_manager' (1621e772-9b9c-483d-97d7-e84e2bea7acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89351826-0700-499b-87ce-321261e1333a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:28 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6bca20c-1078-4486-bb45-3b66ce3ccad0 Jul 03 01:19:28 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89351826-0700-499b-87ce-321261e1333a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1557538118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e746818-315d-4866-a072-0b298f025bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc863b9fc774fce92ce68e3ab0a7b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f4837ae5-964f-44b1-9d8b-e2c659713db8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:19:28Z,use_quota=True,user_id='d3a1db0a72d241079e01bc156f48b320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b19c5928-e0cf-4567-a8fd-76fba25aed9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b19c5928-e0cf-4567-a8fd-76fba25aed9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949545b9-672d-42d5-9f65-3a8ebacb89fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949545b9-672d-42d5-9f65-3a8ebacb89fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5e746818-315d-4866-a072-0b298f025bca', 'volume_name': 'volume-5e746818-315d-4866-a072-0b298f025bca', 'volume_size': 1, 'snapshot_id': 'f4837ae5-964f-44b1-9d8b-e2c659713db8'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03bde42c-efeb-4553-b8a8-79a3c54d4fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03bde42c-efeb-4553-b8a8-79a3c54d4fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:28 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a91d7ff-1b7c-4ba8-9eac-f8ff0929e0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:28 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Volume 5e746818-315d-4866-a072-0b298f025bca: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5e746818-315d-4866-a072-0b298f025bca', 'volume_size': 1, 'snapshot_id': 'f4837ae5-964f-44b1-9d8b-e2c659713db8'} Jul 03 01:19:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:28 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0e51ebac-4b65-4d9d-9553-36d0b9aff0e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7" returned: 0 in 1.238s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0e51ebac-4b65-4d9d-9553-36d0b9aff0e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.5d8de84a-d59d-43fc-9d85-8efdd43ac99c 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:28 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.5d8de84a-d59d-43fc-9d85-8efdd43ac99c 1G Jul 03 01:19:28 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:29 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-15cdf018-a0d8-4122-804d-15ba5a6da4bb tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6bca20c-1078-4486-bb45-3b66ce3ccad0" returned: 0 in 0.970s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-15cdf018-a0d8-4122-804d-15ba5a6da4bb tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6bca20c-1078-4486-bb45-3b66ce3ccad0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:29 devstack sudo[103188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6bca20c-1078-4486-bb45-3b66ce3ccad0 Jul 03 01:19:29 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:30 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0e51ebac-4b65-4d9d-9553-36d0b9aff0e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.5d8de84a-d59d-43fc-9d85-8efdd43ac99c 1G" returned: 0 in 1.157s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0e51ebac-4b65-4d9d-9553-36d0b9aff0e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b410be-62fd-4867-9dcc-0489ee1907a7 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.5d8de84a-d59d-43fc-9d85-8efdd43ac99c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:30 devstack sudo[103198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b410be-62fd-4867-9dcc-0489ee1907a7 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.5d8de84a-d59d-43fc-9d85-8efdd43ac99c Jul 03 01:19:30 devstack sudo[103198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:30 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-15cdf018-a0d8-4122-804d-15ba5a6da4bb tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e6bca20c-1078-4486-bb45-3b66ce3ccad0" returned: 0 in 0.853s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-15cdf018-a0d8-4122-804d-15ba5a6da4bb tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-quobyte-e6bca20c-1078-4486-bb45-3b66ce3ccad0" released by "delete_volume" :: held 1.911s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:30 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-15cdf018-a0d8-4122-804d-15ba5a6da4bb tempest-CreateVolumesFromSnapshotTest-437047707 None] Created reservations ['b2c98299-fc4c-445f-a985-1be8a635904f', '6fa0239c-b8e9-4186-acfb-bf0d2c7bebaf', 'a7978f55-182b-41a2-ace6-e7df1c95b8ab', '73766abf-64be-4d86-b06c-5efe25306ef8'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:19:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-15cdf018-a0d8-4122-804d-15ba5a6da4bb tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-15cdf018-a0d8-4122-804d-15ba5a6da4bb tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-15cdf018-a0d8-4122-804d-15ba5a6da4bb tempest-CreateVolumesFromSnapshotTest-437047707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-15cdf018-a0d8-4122-804d-15ba5a6da4bb tempest-CreateVolumesFromSnapshotTest-437047707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-15cdf018-a0d8-4122-804d-15ba5a6da4bb tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-15cdf018-a0d8-4122-804d-15ba5a6da4bb tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:30 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:19:30 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:31 devstack sudo[103198]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0e51ebac-4b65-4d9d-9553-36d0b9aff0e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b410be-62fd-4867-9dcc-0489ee1907a7 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.5d8de84a-d59d-43fc-9d85-8efdd43ac99c" returned: 0 in 1.025s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:31 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-0e51ebac-4b65-4d9d-9553-36d0b9aff0e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.5d8de84a-d59d-43fc-9d85-8efdd43ac99c is being set with open permissions: ugo+rw Jul 03 01:19:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0e51ebac-4b65-4d9d-9553-36d0b9aff0e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.5d8de84a-d59d-43fc-9d85-8efdd43ac99c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:31 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.5d8de84a-d59d-43fc-9d85-8efdd43ac99c Jul 03 01:19:31 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:31 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-15cdf018-a0d8-4122-804d-15ba5a6da4bb tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.011s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:31 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-15cdf018-a0d8-4122-804d-15ba5a6da4bb tempest-CreateVolumesFromSnapshotTest-437047707 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:19:31 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-15cdf018-a0d8-4122-804d-15ba5a6da4bb tempest-CreateVolumesFromSnapshotTest-437047707 None] Deleted volume successfully. Jul 03 01:19:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f4db9ba9-7a43-46d6-b7f0-25ac36caf32d tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "cinder-68fb93c8-ee31-4de7-9751-14d6bc2f34b2-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-15cdf018-a0d8-4122-804d-15ba5a6da4bb tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-e6bca20c-1078-4486-bb45-3b66ce3ccad0-delete_volume" released by "delete_volume" :: held 3.541s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f4db9ba9-7a43-46d6-b7f0-25ac36caf32d tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-68fb93c8-ee31-4de7-9751-14d6bc2f34b2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f4db9ba9-7a43-46d6-b7f0-25ac36caf32d tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "cinder-quobyte-68fb93c8-ee31-4de7-9751-14d6bc2f34b2" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f4db9ba9-7a43-46d6-b7f0-25ac36caf32d tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-quobyte-68fb93c8-ee31-4de7-9751-14d6bc2f34b2" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:31 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[441f16b4-c72c-4b40-9206-3762ba1b4ec1]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f4db9ba9-7a43-46d6-b7f0-25ac36caf32d tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-68fb93c8-ee31-4de7-9751-14d6bc2f34b2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:31 devstack sudo[103208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-68fb93c8-ee31-4de7-9751-14d6bc2f34b2 Jul 03 01:19:31 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:32 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0e51ebac-4b65-4d9d-9553-36d0b9aff0e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.5d8de84a-d59d-43fc-9d85-8efdd43ac99c" returned: 0 in 0.969s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0e51ebac-4b65-4d9d-9553-36d0b9aff0e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:32 devstack sudo[103212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.info Jul 03 01:19:32 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:32 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f4db9ba9-7a43-46d6-b7f0-25ac36caf32d tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-68fb93c8-ee31-4de7-9751-14d6bc2f34b2" returned: 0 in 0.976s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f4db9ba9-7a43-46d6-b7f0-25ac36caf32d tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-68fb93c8-ee31-4de7-9751-14d6bc2f34b2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:32 devstack sudo[103217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-68fb93c8-ee31-4de7-9751-14d6bc2f34b2 Jul 03 01:19:32 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:33 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0e51ebac-4b65-4d9d-9553-36d0b9aff0e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.info" returned: 0 in 0.910s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:33 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-0e51ebac-4b65-4d9d-9553-36d0b9aff0e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.info is being set with open permissions: ugo+rw Jul 03 01:19:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0e51ebac-4b65-4d9d-9553-36d0b9aff0e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:33 devstack sudo[103221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.info Jul 03 01:19:33 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:33 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f4db9ba9-7a43-46d6-b7f0-25ac36caf32d tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-68fb93c8-ee31-4de7-9751-14d6bc2f34b2" returned: 0 in 0.826s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f4db9ba9-7a43-46d6-b7f0-25ac36caf32d tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-quobyte-68fb93c8-ee31-4de7-9751-14d6bc2f34b2" released by "delete_volume" :: held 1.851s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:33 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-f4db9ba9-7a43-46d6-b7f0-25ac36caf32d tempest-CreateVolumesFromSnapshotTest-437047707 None] Created reservations ['198ed8dd-258f-4518-ad56-f51099fd9e17', '788f223c-aa28-42e4-9324-7eb20b410c8d', '822e50f8-3b7b-477a-a656-7ddeb40b9a63', 'c33fef07-2e20-42f3-aa1a-ec9194894281'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:19:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f4db9ba9-7a43-46d6-b7f0-25ac36caf32d tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f4db9ba9-7a43-46d6-b7f0-25ac36caf32d tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f4db9ba9-7a43-46d6-b7f0-25ac36caf32d tempest-CreateVolumesFromSnapshotTest-437047707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f4db9ba9-7a43-46d6-b7f0-25ac36caf32d tempest-CreateVolumesFromSnapshotTest-437047707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f4db9ba9-7a43-46d6-b7f0-25ac36caf32d tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f4db9ba9-7a43-46d6-b7f0-25ac36caf32d tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:33 devstack sudo[103224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:19:33 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:33 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0e51ebac-4b65-4d9d-9553-36d0b9aff0e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.info" returned: 0 in 0.799s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0e51ebac-4b65-4d9d-9553-36d0b9aff0e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.255s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.367s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Acquiring lock "cinder-quobyte-f4837ae5-964f-44b1-9d8b-e2c659713db8-5e746818-315d-4866-a072-0b298f025bca" by "_create_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a07de8e4-f014-4b19-91f2-38ec379ea0f8 tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "cinder-e2864f7c-e768-43ae-b64b-6b1be706f12c-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a07de8e4-f014-4b19-91f2-38ec379ea0f8 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-e2864f7c-e768-43ae-b64b-6b1be706f12c-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Lock "cinder-quobyte-f4837ae5-964f-44b1-9d8b-e2c659713db8-5e746818-315d-4866-a072-0b298f025bca" acquired by "_create_volume_from_snapshot" :: waited 0.090s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Creating volume 5e746818-315d-4866-a072-0b298f025bca from snapshot f4837ae5-964f-44b1-9d8b-e2c659713db8 {{(pid=86772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 01:19:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:19:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Acquiring lock "cinder-quobyte-5e746818-315d-4866-a072-0b298f025bca" by "_copy_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:33 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-0e51ebac-4b65-4d9d-9553-36d0b9aff0e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Create snapshot completed successfully Jul 03 01:19:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Lock "cinder-quobyte-5e746818-315d-4866-a072-0b298f025bca" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] snapshot: f4837ae5-964f-44b1-9d8b-e2c659713db8, volume: 5e746818-315d-4866-a072-0b298f025bca, {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 01:19:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a07de8e4-f014-4b19-91f2-38ec379ea0f8 tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "cinder-quobyte-e2864f7c-e768-43ae-b64b-6b1be706f12c" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:34 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b437fa5c-2acc-4e71-9c35-f973ab0f011a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.f4837ae5-964f-44b1-9d8b-e2c659713db8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a07de8e4-f014-4b19-91f2-38ec379ea0f8 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-quobyte-e2864f7c-e768-43ae-b64b-6b1be706f12c" acquired by "delete_volume" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:34 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2923426-50e1-416b-8af9-f53c1d7342d4]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a07de8e4-f014-4b19-91f2-38ec379ea0f8 tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e2864f7c-e768-43ae-b64b-6b1be706f12c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:34 devstack sudo[103227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.f4837ae5-964f-44b1-9d8b-e2c659713db8 Jul 03 01:19:34 devstack sudo[103227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:34 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e2864f7c-e768-43ae-b64b-6b1be706f12c Jul 03 01:19:34 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:34 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f4db9ba9-7a43-46d6-b7f0-25ac36caf32d tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.872s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:34 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-f4db9ba9-7a43-46d6-b7f0-25ac36caf32d tempest-CreateVolumesFromSnapshotTest-437047707 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:19:34 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f4db9ba9-7a43-46d6-b7f0-25ac36caf32d tempest-CreateVolumesFromSnapshotTest-437047707 None] Deleted volume successfully. Jul 03 01:19:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f4db9ba9-7a43-46d6-b7f0-25ac36caf32d tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-68fb93c8-ee31-4de7-9751-14d6bc2f34b2-delete_volume" released by "delete_volume" :: held 3.070s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:35 devstack sudo[103227]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.f4837ae5-964f-44b1-9d8b-e2c659713db8" returned: 0 in 1.112s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:19:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 01:19:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Creating direct copy from snapshot {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 01:19:35 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[db02026a-3f18-4da8-908e-d1d0aa22902b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-552895f6-982f-4db7-81ef-f940a94fdf23 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Acquiring lock "cinder-5d8de84a-d59d-43fc-9d85-8efdd43ac99c-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:35 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a07de8e4-f014-4b19-91f2-38ec379ea0f8 tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e2864f7c-e768-43ae-b64b-6b1be706f12c" returned: 0 in 1.255s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a07de8e4-f014-4b19-91f2-38ec379ea0f8 tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e2864f7c-e768-43ae-b64b-6b1be706f12c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-552895f6-982f-4db7-81ef-f940a94fdf23 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Lock "cinder-5d8de84a-d59d-43fc-9d85-8efdd43ac99c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-552895f6-982f-4db7-81ef-f940a94fdf23 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Acquiring lock "cinder-quobyte-d4b410be-62fd-4867-9dcc-0489ee1907a7" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:35 devstack sudo[103238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 Jul 03 01:19:35 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-552895f6-982f-4db7-81ef-f940a94fdf23 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Lock "cinder-quobyte-d4b410be-62fd-4867-9dcc-0489ee1907a7" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-552895f6-982f-4db7-81ef-f940a94fdf23 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Acquiring lock "cinder-quobyte-5d8de84a-d59d-43fc-9d85-8efdd43ac99c" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:35 devstack sudo[103239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e2864f7c-e768-43ae-b64b-6b1be706f12c Jul 03 01:19:35 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-552895f6-982f-4db7-81ef-f940a94fdf23 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Lock "cinder-quobyte-5d8de84a-d59d-43fc-9d85-8efdd43ac99c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-552895f6-982f-4db7-81ef-f940a94fdf23 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Deleting offline snapshot 5d8de84a-d59d-43fc-9d85-8efdd43ac99c of volume d4b410be-62fd-4867-9dcc-0489ee1907a7 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:19:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-552895f6-982f-4db7-81ef-f940a94fdf23 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] snapshot_file for this snap is: volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.5d8de84a-d59d-43fc-9d85-8efdd43ac99c {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:19:35 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[39507bb6-9a26-49c9-914a-c0ab2148f949]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-552895f6-982f-4db7-81ef-f940a94fdf23 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.5d8de84a-d59d-43fc-9d85-8efdd43ac99c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:35 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.5d8de84a-d59d-43fc-9d85-8efdd43ac99c Jul 03 01:19:35 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:36 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a07de8e4-f014-4b19-91f2-38ec379ea0f8 tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e2864f7c-e768-43ae-b64b-6b1be706f12c" returned: 0 in 1.305s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a07de8e4-f014-4b19-91f2-38ec379ea0f8 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-quobyte-e2864f7c-e768-43ae-b64b-6b1be706f12c" released by "delete_volume" :: held 2.616s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:36 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017" returned: 0 in 1.559s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:36 devstack cinder-volume[86772]: DEBUG cinder.utils [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Path /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e746818-315d-4866-a072-0b298f025bca not found in is_blk_device check {{(pid=86772) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 01:19:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e746818-315d-4866-a072-0b298f025bca {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:36 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e746818-315d-4866-a072-0b298f025bca Jul 03 01:19:36 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:36 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-a07de8e4-f014-4b19-91f2-38ec379ea0f8 tempest-CreateVolumesFromSnapshotTest-437047707 None] Created reservations ['2e6d44a6-a42d-4f35-9a2b-ed8880c92482', '009a52e0-27ea-4c78-a8ac-939d47ee06a0', 'b9c731a9-5d58-441f-bf20-40436be38e35', '24d8d0cf-d289-4807-af66-5823ed733879'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:19:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a07de8e4-f014-4b19-91f2-38ec379ea0f8 tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a07de8e4-f014-4b19-91f2-38ec379ea0f8 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a07de8e4-f014-4b19-91f2-38ec379ea0f8 tempest-CreateVolumesFromSnapshotTest-437047707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a07de8e4-f014-4b19-91f2-38ec379ea0f8 tempest-CreateVolumesFromSnapshotTest-437047707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a07de8e4-f014-4b19-91f2-38ec379ea0f8 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a07de8e4-f014-4b19-91f2-38ec379ea0f8 tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:37 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:19:37 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:37 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-552895f6-982f-4db7-81ef-f940a94fdf23 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.5d8de84a-d59d-43fc-9d85-8efdd43ac99c" returned: 0 in 1.876s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-552895f6-982f-4db7-81ef-f940a94fdf23 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4b410be-62fd-4867-9dcc-0489ee1907a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:19:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cb23e544-a4ba-43bd-97dd-ad37e723c05c tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "cinder-54a4b3fe-64a8-44a9-9970-d60a1e0d86fe-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:37 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[95802e62-f02f-4ad5-8b5d-b5b1f515f3dd]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-552895f6-982f-4db7-81ef-f940a94fdf23 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cb23e544-a4ba-43bd-97dd-ad37e723c05c tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-54a4b3fe-64a8-44a9-9970-d60a1e0d86fe-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cb23e544-a4ba-43bd-97dd-ad37e723c05c tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "cinder-quobyte-54a4b3fe-64a8-44a9-9970-d60a1e0d86fe" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cb23e544-a4ba-43bd-97dd-ad37e723c05c tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-quobyte-54a4b3fe-64a8-44a9-9970-d60a1e0d86fe" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:37 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14590e5-c162-40d3-951d-bae906f1a28a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cb23e544-a4ba-43bd-97dd-ad37e723c05c tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54a4b3fe-64a8-44a9-9970-d60a1e0d86fe {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:37 devstack sudo[103255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7 Jul 03 01:19:37 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:38 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54a4b3fe-64a8-44a9-9970-d60a1e0d86fe Jul 03 01:19:38 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:39 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a07de8e4-f014-4b19-91f2-38ec379ea0f8 tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 2.712s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:39 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-a07de8e4-f014-4b19-91f2-38ec379ea0f8 tempest-CreateVolumesFromSnapshotTest-437047707 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:19:39 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a07de8e4-f014-4b19-91f2-38ec379ea0f8 tempest-CreateVolumesFromSnapshotTest-437047707 None] Deleted volume successfully. Jul 03 01:19:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a07de8e4-f014-4b19-91f2-38ec379ea0f8 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-e2864f7c-e768-43ae-b64b-6b1be706f12c-delete_volume" released by "delete_volume" :: held 5.968s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:40 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-552895f6-982f-4db7-81ef-f940a94fdf23 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7" returned: 0 in 2.839s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-552895f6-982f-4db7-81ef-f940a94fdf23 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.5d8de84a-d59d-43fc-9d85-8efdd43ac99c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:40 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.5d8de84a-d59d-43fc-9d85-8efdd43ac99c Jul 03 01:19:40 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:40 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cb23e544-a4ba-43bd-97dd-ad37e723c05c tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54a4b3fe-64a8-44a9-9970-d60a1e0d86fe" returned: 0 in 2.939s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cb23e544-a4ba-43bd-97dd-ad37e723c05c tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54a4b3fe-64a8-44a9-9970-d60a1e0d86fe {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:40 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54a4b3fe-64a8-44a9-9970-d60a1e0d86fe Jul 03 01:19:40 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:42 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cb23e544-a4ba-43bd-97dd-ad37e723c05c tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-54a4b3fe-64a8-44a9-9970-d60a1e0d86fe" returned: 0 in 2.268s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cb23e544-a4ba-43bd-97dd-ad37e723c05c tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-quobyte-54a4b3fe-64a8-44a9-9970-d60a1e0d86fe" released by "delete_volume" :: held 5.290s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:43 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-cb23e544-a4ba-43bd-97dd-ad37e723c05c tempest-CreateVolumesFromSnapshotTest-437047707 None] Created reservations ['32e2a463-7f8a-45d1-a32c-a66ded1ce081', '8ae4bb1b-1b9e-4071-8ede-6255306092b0', '42f0beec-4280-4dff-b7a3-09c3665ced95', '65c9d5ad-0d09-42f7-ba5a-3a863d04b752'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:19:43 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-552895f6-982f-4db7-81ef-f940a94fdf23 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.5d8de84a-d59d-43fc-9d85-8efdd43ac99c" returned: 0 in 2.977s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-552895f6-982f-4db7-81ef-f940a94fdf23 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.5d8de84a-d59d-43fc-9d85-8efdd43ac99c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cb23e544-a4ba-43bd-97dd-ad37e723c05c tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cb23e544-a4ba-43bd-97dd-ad37e723c05c tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cb23e544-a4ba-43bd-97dd-ad37e723c05c tempest-CreateVolumesFromSnapshotTest-437047707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:43 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.5d8de84a-d59d-43fc-9d85-8efdd43ac99c Jul 03 01:19:43 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cb23e544-a4ba-43bd-97dd-ad37e723c05c tempest-CreateVolumesFromSnapshotTest-437047707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cb23e544-a4ba-43bd-97dd-ad37e723c05c tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cb23e544-a4ba-43bd-97dd-ad37e723c05c tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:43 devstack sudo[103304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:19:43 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-97a86fe9-b082-4c70-ba3e-03f1478f1c8f tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "cinder-23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-97a86fe9-b082-4c70-ba3e-03f1478f1c8f tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-97a86fe9-b082-4c70-ba3e-03f1478f1c8f tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "cinder-quobyte-23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-97a86fe9-b082-4c70-ba3e-03f1478f1c8f tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-quobyte-23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f" acquired by "delete_volume" :: waited 0.045s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:44 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ddcdc0-01fa-4ac2-837a-be779e07336b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-97a86fe9-b082-4c70-ba3e-03f1478f1c8f tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:44 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f Jul 03 01:19:44 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:45 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-552895f6-982f-4db7-81ef-f940a94fdf23 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7.5d8de84a-d59d-43fc-9d85-8efdd43ac99c" returned: 0 in 2.194s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-552895f6-982f-4db7-81ef-f940a94fdf23 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Lock "cinder-quobyte-5d8de84a-d59d-43fc-9d85-8efdd43ac99c" released by "_delete_snapshot" :: held 10.143s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:45 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-552895f6-982f-4db7-81ef-f940a94fdf23 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Lock "cinder-quobyte-d4b410be-62fd-4867-9dcc-0489ee1907a7" released by "delete_snapshot" :: held 10.178s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e746818-315d-4866-a072-0b298f025bca" returned: 0 in 8.835s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:45 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae323bdb-1cde-48b7-aecb-60bb2a218d78]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:45 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cb23e544-a4ba-43bd-97dd-ad37e723c05c tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 2.230s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:45 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-cb23e544-a4ba-43bd-97dd-ad37e723c05c tempest-CreateVolumesFromSnapshotTest-437047707 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:19:45 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-cb23e544-a4ba-43bd-97dd-ad37e723c05c tempest-CreateVolumesFromSnapshotTest-437047707 None] Deleted volume successfully. Jul 03 01:19:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cb23e544-a4ba-43bd-97dd-ad37e723c05c tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-54a4b3fe-64a8-44a9-9970-d60a1e0d86fe-delete_volume" released by "delete_volume" :: held 8.170s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:45 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-552895f6-982f-4db7-81ef-f940a94fdf23 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Created reservations ['42af1069-d41a-41bf-98a2-46121a6464a7', 'd4a5c112-4a11-49d3-ae4c-54a8212c0ef6', '046931cb-9fd9-4065-bdbc-76b121b73978', 'bc2fd56d-8c20-4593-bb63-86806434b33a'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:19:45 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 Jul 03 01:19:45 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:45 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-552895f6-982f-4db7-81ef-f940a94fdf23 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Delete snapshot completed successfully. Jul 03 01:19:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-552895f6-982f-4db7-81ef-f940a94fdf23 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Lock "cinder-5d8de84a-d59d-43fc-9d85-8efdd43ac99c-delete_snapshot" released by "delete_snapshot" :: held 10.425s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:46 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-97a86fe9-b082-4c70-ba3e-03f1478f1c8f tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f" returned: 0 in 1.601s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-97a86fe9-b082-4c70-ba3e-03f1478f1c8f tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:46 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f Jul 03 01:19:46 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-07695969-50eb-43ce-81f1-33cf5b4e8205 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Acquiring lock "cinder-d4b410be-62fd-4867-9dcc-0489ee1907a7-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-07695969-50eb-43ce-81f1-33cf5b4e8205 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Lock "cinder-d4b410be-62fd-4867-9dcc-0489ee1907a7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-07695969-50eb-43ce-81f1-33cf5b4e8205 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Acquiring lock "cinder-quobyte-d4b410be-62fd-4867-9dcc-0489ee1907a7" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-07695969-50eb-43ce-81f1-33cf5b4e8205 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Lock "cinder-quobyte-d4b410be-62fd-4867-9dcc-0489ee1907a7" acquired by "delete_volume" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:46 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e51bc0-9a7f-416e-8777-4eee104b8b4c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-07695969-50eb-43ce-81f1-33cf5b4e8205 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:46 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017" returned: 0 in 1.242s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:46 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Image conversion details: src /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017, size 1024.00 MB, duration 8.84 sec, destination /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e746818-315d-4866-a072-0b298f025bca {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:19:46 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Converted 1024.00 MB image at 115.84 MB/s Jul 03 01:19:46 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e746818-315d-4866-a072-0b298f025bca is being set with open permissions: ugo+rw Jul 03 01:19:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e746818-315d-4866-a072-0b298f025bca {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:46 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-97a86fe9-b082-4c70-ba3e-03f1478f1c8f tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f" returned: 0 in 0.858s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-97a86fe9-b082-4c70-ba3e-03f1478f1c8f tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-quobyte-23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f" released by "delete_volume" :: held 2.598s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:46 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e746818-315d-4866-a072-0b298f025bca Jul 03 01:19:46 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:47 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7 Jul 03 01:19:47 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:47 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-97a86fe9-b082-4c70-ba3e-03f1478f1c8f tempest-CreateVolumesFromSnapshotTest-437047707 None] Created reservations ['d31a6304-d53a-49a1-b201-32d41956782d', '3624bfe0-6b9e-4786-9b24-a28f6d4568fa', '0942ec9e-f143-4420-b8d9-16a2ac426a11', '67b45027-af92-4cbb-bc2c-21cde611139a'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:19:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-97a86fe9-b082-4c70-ba3e-03f1478f1c8f tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-97a86fe9-b082-4c70-ba3e-03f1478f1c8f tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-97a86fe9-b082-4c70-ba3e-03f1478f1c8f tempest-CreateVolumesFromSnapshotTest-437047707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-97a86fe9-b082-4c70-ba3e-03f1478f1c8f tempest-CreateVolumesFromSnapshotTest-437047707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-97a86fe9-b082-4c70-ba3e-03f1478f1c8f tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-97a86fe9-b082-4c70-ba3e-03f1478f1c8f tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:47 devstack sudo[103337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:19:47 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:47 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-07695969-50eb-43ce-81f1-33cf5b4e8205 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7" returned: 0 in 0.976s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-07695969-50eb-43ce-81f1-33cf5b4e8205 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:47 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7 Jul 03 01:19:47 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9a0d06b3-69e8-4333-b135-eba840490256 tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "cinder-e32ca829-76c1-443f-ae93-bc7d4d3b0bb7-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:47 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e746818-315d-4866-a072-0b298f025bca" returned: 0 in 0.987s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Lock "cinder-quobyte-5e746818-315d-4866-a072-0b298f025bca" released by "_copy_volume_from_snapshot" :: held 13.911s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9a0d06b3-69e8-4333-b135-eba840490256 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-e32ca829-76c1-443f-ae93-bc7d4d3b0bb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9a0d06b3-69e8-4333-b135-eba840490256 tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "cinder-quobyte-6067e012-0d9a-42c5-9c90-ae357cea38fa" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Lock "cinder-quobyte-f4837ae5-964f-44b1-9d8b-e2c659713db8-5e746818-315d-4866-a072-0b298f025bca" released by "_create_volume_from_snapshot" :: held 14.007s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.102s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9a0d06b3-69e8-4333-b135-eba840490256 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-quobyte-6067e012-0d9a-42c5-9c90-ae357cea38fa" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9a0d06b3-69e8-4333-b135-eba840490256 tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "cinder-quobyte-e32ca829-76c1-443f-ae93-bc7d4d3b0bb7" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9a0d06b3-69e8-4333-b135-eba840490256 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-quobyte-e32ca829-76c1-443f-ae93-bc7d4d3b0bb7" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-9a0d06b3-69e8-4333-b135-eba840490256 tempest-CreateVolumesFromSnapshotTest-437047707 None] Deleting offline snapshot e32ca829-76c1-443f-ae93-bc7d4d3b0bb7 of volume 6067e012-0d9a-42c5-9c90-ae357cea38fa {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:19:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-9a0d06b3-69e8-4333-b135-eba840490256 tempest-CreateVolumesFromSnapshotTest-437047707 None] snapshot_file for this snap is: volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.e32ca829-76c1-443f-ae93-bc7d4d3b0bb7 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:19:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a91d7ff-1b7c-4ba8-9eac-f8ff0929e0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e746818-315d-4866-a072-0b298f025bca', 'volume_size': 1, 'snapshot_id': 'f4837ae5-964f-44b1-9d8b-e2c659713db8'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d60a4c2f-ce89-4a18-aa72-2583ed0efc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:19:48 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:48 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e3e2e5-6061-4114-a89e-8b71a0fa0a9c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9a0d06b3-69e8-4333-b135-eba840490256 tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.e32ca829-76c1-443f-ae93-bc7d4d3b0bb7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-97a86fe9-b082-4c70-ba3e-03f1478f1c8f tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.821s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:48 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-97a86fe9-b082-4c70-ba3e-03f1478f1c8f tempest-CreateVolumesFromSnapshotTest-437047707 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:19:48 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-97a86fe9-b082-4c70-ba3e-03f1478f1c8f tempest-CreateVolumesFromSnapshotTest-437047707 None] Deleted volume successfully. Jul 03 01:19:48 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Volume volume-5e746818-315d-4866-a072-0b298f025bca (5e746818-315d-4866-a072-0b298f025bca): created successfully Jul 03 01:19:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d60a4c2f-ce89-4a18-aa72-2583ed0efc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:19:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Flow 'volume_create_manager' (1621e772-9b9c-483d-97d7-e84e2bea7acc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:19:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-97a86fe9-b082-4c70-ba3e-03f1478f1c8f tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-23f1e4a2-4a89-46a9-bbdc-74d1b2d6b70f-delete_volume" released by "delete_volume" :: held 4.008s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:48 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-efbb8306-96fb-4512-84fe-731508179a84 tempest-TestStampPattern-1880660764 None] Created volume successfully. Jul 03 01:19:48 devstack sudo[103346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.e32ca829-76c1-443f-ae93-bc7d4d3b0bb7 Jul 03 01:19:48 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:48 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-07695969-50eb-43ce-81f1-33cf5b4e8205 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d4b410be-62fd-4867-9dcc-0489ee1907a7" returned: 0 in 0.980s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-07695969-50eb-43ce-81f1-33cf5b4e8205 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Lock "cinder-quobyte-d4b410be-62fd-4867-9dcc-0489ee1907a7" released by "delete_volume" :: held 2.066s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:48 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-07695969-50eb-43ce-81f1-33cf5b4e8205 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Created reservations ['9275b5fc-2dc8-487f-b739-0808e444ff16', 'ecce4258-2359-4d71-8395-72eb5b957e43', 'ea7fac09-28f5-4420-bb59-43f5d31a40a3', '46050dff-12d3-42f4-b73d-731ba5329aef'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:19:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-07695969-50eb-43ce-81f1-33cf5b4e8205 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-07695969-50eb-43ce-81f1-33cf5b4e8205 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-07695969-50eb-43ce-81f1-33cf5b4e8205 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-07695969-50eb-43ce-81f1-33cf5b4e8205 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-07695969-50eb-43ce-81f1-33cf5b4e8205 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-07695969-50eb-43ce-81f1-33cf5b4e8205 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:49 devstack sudo[103386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:19:49 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:49 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9a0d06b3-69e8-4333-b135-eba840490256 tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.e32ca829-76c1-443f-ae93-bc7d4d3b0bb7" returned: 0 in 1.680s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-9a0d06b3-69e8-4333-b135-eba840490256 tempest-CreateVolumesFromSnapshotTest-437047707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6067e012-0d9a-42c5-9c90-ae357cea38fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:19:49 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b713abe8-78e4-451c-be93-196e7ea730cb]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9a0d06b3-69e8-4333-b135-eba840490256 tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:50 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa Jul 03 01:19:50 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:50 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-07695969-50eb-43ce-81f1-33cf5b4e8205 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.583s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:50 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-07695969-50eb-43ce-81f1-33cf5b4e8205 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:19:50 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-07695969-50eb-43ce-81f1-33cf5b4e8205 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Deleted volume successfully. Jul 03 01:19:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-07695969-50eb-43ce-81f1-33cf5b4e8205 tempest-VolumeSnapshotQuotasNegativeTestJSON-937674839 None] Lock "cinder-d4b410be-62fd-4867-9dcc-0489ee1907a7-delete_volume" released by "delete_volume" :: held 4.127s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:52 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9a0d06b3-69e8-4333-b135-eba840490256 tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa" returned: 0 in 2.373s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9a0d06b3-69e8-4333-b135-eba840490256 tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.e32ca829-76c1-443f-ae93-bc7d4d3b0bb7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:52 devstack sudo[103403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.e32ca829-76c1-443f-ae93-bc7d4d3b0bb7 Jul 03 01:19:52 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:53 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9a0d06b3-69e8-4333-b135-eba840490256 tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.e32ca829-76c1-443f-ae93-bc7d4d3b0bb7" returned: 0 in 1.476s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9a0d06b3-69e8-4333-b135-eba840490256 tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.e32ca829-76c1-443f-ae93-bc7d4d3b0bb7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:53 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.e32ca829-76c1-443f-ae93-bc7d4d3b0bb7 Jul 03 01:19:53 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:54 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9a0d06b3-69e8-4333-b135-eba840490256 tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa.e32ca829-76c1-443f-ae93-bc7d4d3b0bb7" returned: 0 in 1.079s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9a0d06b3-69e8-4333-b135-eba840490256 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-quobyte-e32ca829-76c1-443f-ae93-bc7d4d3b0bb7" released by "_delete_snapshot" :: held 6.819s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9a0d06b3-69e8-4333-b135-eba840490256 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-quobyte-6067e012-0d9a-42c5-9c90-ae357cea38fa" released by "delete_snapshot" :: held 6.850s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:54 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-9a0d06b3-69e8-4333-b135-eba840490256 tempest-CreateVolumesFromSnapshotTest-437047707 None] Created reservations ['0b87c7a2-7c35-42a7-9d7f-b90b91d4f44a', 'a272dba0-69c9-4507-b618-cdfdc1847d93', '08716339-6913-470b-a7b2-1e82763a425b', '9d00669f-45db-43b0-a1c1-09acdf78e8c4'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:19:55 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9a0d06b3-69e8-4333-b135-eba840490256 tempest-CreateVolumesFromSnapshotTest-437047707 None] Delete snapshot completed successfully. Jul 03 01:19:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9a0d06b3-69e8-4333-b135-eba840490256 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-e32ca829-76c1-443f-ae93-bc7d4d3b0bb7-delete_snapshot" released by "delete_snapshot" :: held 7.095s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-efb4a1e7-7313-4b5d-b41e-7d5ca5254482 tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "cinder-6067e012-0d9a-42c5-9c90-ae357cea38fa-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-efb4a1e7-7313-4b5d-b41e-7d5ca5254482 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-6067e012-0d9a-42c5-9c90-ae357cea38fa-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-efb4a1e7-7313-4b5d-b41e-7d5ca5254482 tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "cinder-quobyte-6067e012-0d9a-42c5-9c90-ae357cea38fa" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:19:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-efb4a1e7-7313-4b5d-b41e-7d5ca5254482 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-quobyte-6067e012-0d9a-42c5-9c90-ae357cea38fa" acquired by "delete_volume" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:19:55 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a05263-4cea-449a-b073-f9f247a78d3d]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:19:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-efb4a1e7-7313-4b5d-b41e-7d5ca5254482 tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:55 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa Jul 03 01:19:55 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:57 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-efb4a1e7-7313-4b5d-b41e-7d5ca5254482 tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa" returned: 0 in 1.860s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-efb4a1e7-7313-4b5d-b41e-7d5ca5254482 tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:57 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa Jul 03 01:19:57 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:19:59 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Jul 03 01:19:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-efb4a1e7-7313-4b5d-b41e-7d5ca5254482 tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6067e012-0d9a-42c5-9c90-ae357cea38fa" returned: 0 in 1.611s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:19:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-efb4a1e7-7313-4b5d-b41e-7d5ca5254482 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-quobyte-6067e012-0d9a-42c5-9c90-ae357cea38fa" released by "delete_volume" :: held 3.564s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:19:59 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-efb4a1e7-7313-4b5d-b41e-7d5ca5254482 tempest-CreateVolumesFromSnapshotTest-437047707 None] Created reservations ['0a684d5d-e16f-4975-be5e-89542c53a9aa', '1c6e3a5f-7585-4bc1-9d7c-9c6d8145a8a2', '25f04ed6-d655-4adf-9e6b-0597bcddd936', '8a46740f-65d9-4394-b70c-5738632251a4'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:19:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-efb4a1e7-7313-4b5d-b41e-7d5ca5254482 tempest-CreateVolumesFromSnapshotTest-437047707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:19:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-efb4a1e7-7313-4b5d-b41e-7d5ca5254482 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:19:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-efb4a1e7-7313-4b5d-b41e-7d5ca5254482 tempest-CreateVolumesFromSnapshotTest-437047707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:19:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-efb4a1e7-7313-4b5d-b41e-7d5ca5254482 tempest-CreateVolumesFromSnapshotTest-437047707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:19:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-efb4a1e7-7313-4b5d-b41e-7d5ca5254482 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:19:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-efb4a1e7-7313-4b5d-b41e-7d5ca5254482 tempest-CreateVolumesFromSnapshotTest-437047707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:19:59 devstack sudo[103421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:19:59 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:01 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-efb4a1e7-7313-4b5d-b41e-7d5ca5254482 tempest-CreateVolumesFromSnapshotTest-437047707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.473s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:01 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-efb4a1e7-7313-4b5d-b41e-7d5ca5254482 tempest-CreateVolumesFromSnapshotTest-437047707 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:20:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-efb4a1e7-7313-4b5d-b41e-7d5ca5254482 tempest-CreateVolumesFromSnapshotTest-437047707 None] Deleted volume successfully. Jul 03 01:20:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-efb4a1e7-7313-4b5d-b41e-7d5ca5254482 tempest-CreateVolumesFromSnapshotTest-437047707 None] Lock "cinder-6067e012-0d9a-42c5-9c90-ae357cea38fa-delete_volume" released by "delete_volume" :: held 5.461s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Flow 'volume_create_manager' (999476c9-47e2-4c14-a50c-9652ea5031f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6ffb36-13a1-4c1b-aeb2-9ab37ede1ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6ffb36-13a1-4c1b-aeb2-9ab37ede1ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-235518990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff43653-027a-433a-adac-7a30a93b7c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f106c9d560714bf3a6caf70d87549c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:06Z,use_quota=True,user_id='44bec659f5504067b1712bf922a3a281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c8a84a-a37d-47af-8437-0c143257a8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c8a84a-a37d-47af-8437-0c143257a8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6234ec35-b59c-42f9-b34b-90edfb17dde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6234ec35-b59c-42f9-b34b-90edfb17dde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ff43653-027a-433a-adac-7a30a93b7c48', 'volume_name': 'volume-4ff43653-027a-433a-adac-7a30a93b7c48', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (274b8a76-1575-4da1-941d-4cbb7b076aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (274b8a76-1575-4da1-941d-4cbb7b076aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd85d6d7-564c-40c8-b6ac-f9a2d7b488f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:06 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Volume 4ff43653-027a-433a-adac-7a30a93b7c48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ff43653-027a-433a-adac-7a30a93b7c48', 'volume_size': 1} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-235518990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff43653-027a-433a-adac-7a30a93b7c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f106c9d560714bf3a6caf70d87549c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:06Z,use_quota=True,user_id='44bec659f5504067b1712bf922a3a281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Creating volume 4ff43653-027a-433a-adac-7a30a93b7c48 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:20:06 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:06 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48 1073741824 Jul 03 01:20:06 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Flow 'volume_create_manager' (58361fc9-1d1c-46da-93f8-f0c73e3594cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d304f56-73cf-40cd-9d0a-0b540fb7fa69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d304f56-73cf-40cd-9d0a-0b540fb7fa69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-162015108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed37012-ee96-4c08-8adc-5767968238bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8b04204cf14d89bfcb4f6350f0e77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:07Z,use_quota=True,user_id='4ec9623466ca4312bd1b53adfd5b7522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68cf5613-55ef-4027-9aee-834fe49c42bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68cf5613-55ef-4027-9aee-834fe49c42bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc09467-eadc-4d20-bd93-144e50659872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc09467-eadc-4d20-bd93-144e50659872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ed37012-ee96-4c08-8adc-5767968238bf', 'volume_name': 'volume-3ed37012-ee96-4c08-8adc-5767968238bf', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1e8f7a-1c40-4c6a-a8fc-a59abf4a4bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1e8f7a-1c40-4c6a-a8fc-a59abf4a4bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bbba70a-bd80-4842-a05b-5a38e78c37f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:06 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Volume 3ed37012-ee96-4c08-8adc-5767968238bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ed37012-ee96-4c08-8adc-5767968238bf', 'volume_size': 1} Jul 03 01:20:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:07 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48 1073741824" returned: 0 in 0.998s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:07 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48 Jul 03 01:20:07 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:08 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48" returned: 0 in 0.739s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.498s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-162015108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed37012-ee96-4c08-8adc-5767968238bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8b04204cf14d89bfcb4f6350f0e77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:07Z,use_quota=True,user_id='4ec9623466ca4312bd1b53adfd5b7522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Creating volume 3ed37012-ee96-4c08-8adc-5767968238bf {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:20:08 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3ed37012-ee96-4c08-8adc-5767968238bf 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:08 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3ed37012-ee96-4c08-8adc-5767968238bf 1073741824 Jul 03 01:20:08 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd85d6d7-564c-40c8-b6ac-f9a2d7b488f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ff43653-027a-433a-adac-7a30a93b7c48', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcbef2f4-873e-4cb1-8f86-4e62b6305928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Flow 'volume_create_manager' (3eb1e934-3cbf-42b3-8662-8f8b64227c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e682cbc5-bd99-45ae-8fdd-8ce5843fd0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:08 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Volume volume-4ff43653-027a-433a-adac-7a30a93b7c48 (4ff43653-027a-433a-adac-7a30a93b7c48): created successfully Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcbef2f4-873e-4cb1-8f86-4e62b6305928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Flow 'volume_create_manager' (999476c9-47e2-4c14-a50c-9652ea5031f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e682cbc5-bd99-45ae-8fdd-8ce5843fd0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2036087439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f6af12-cf30-4272-adea-c87db5ff89a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5cf0348fec345efb2a94b2386667b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:08Z,use_quota=True,user_id='9628033c833743e5bd0d19ef5c4cac9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a0730d5-7701-427f-b724-7db6f12a751e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a0730d5-7701-427f-b724-7db6f12a751e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee1e231e-188e-4df5-98cd-f60c6b439af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee1e231e-188e-4df5-98cd-f60c6b439af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6f6af12-cf30-4272-adea-c87db5ff89a1', 'volume_name': 'volume-b6f6af12-cf30-4272-adea-c87db5ff89a1', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8456a9dd-2590-46da-a817-e39880f767bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8456a9dd-2590-46da-a817-e39880f767bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4908982-3cb0-44bb-8cf4-b89ce9b8efeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:08 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Volume b6f6af12-cf30-4272-adea-c87db5ff89a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6f6af12-cf30-4272-adea-c87db5ff89a1', 'volume_size': 1} Jul 03 01:20:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:08 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-729ec189-1d50-4053-bee1-cd80119dd911 tempest-SnapshotDependencyTests-771684542 None] Created volume successfully. Jul 03 01:20:09 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3ed37012-ee96-4c08-8adc-5767968238bf 1073741824" returned: 0 in 0.858s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3ed37012-ee96-4c08-8adc-5767968238bf {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:09 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3ed37012-ee96-4c08-8adc-5767968238bf Jul 03 01:20:09 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-90703381-c091-4263-a115-d191b15e0647 tempest-SnapshotDependencyTests-771684542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:10 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3ed37012-ee96-4c08-8adc-5767968238bf" returned: 0 in 0.707s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:20:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.428s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2036087439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f6af12-cf30-4272-adea-c87db5ff89a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5cf0348fec345efb2a94b2386667b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:08Z,use_quota=True,user_id='9628033c833743e5bd0d19ef5c4cac9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:20:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Creating volume b6f6af12-cf30-4272-adea-c87db5ff89a1 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:20:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:20:10 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:20:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:10 devstack sudo[103474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1 1073741824 Jul 03 01:20:10 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bbba70a-bd80-4842-a05b-5a38e78c37f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ed37012-ee96-4c08-8adc-5767968238bf', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (133c12b1-bf5a-42dc-9c37-db284fe7082d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:10 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Volume volume-3ed37012-ee96-4c08-8adc-5767968238bf (3ed37012-ee96-4c08-8adc-5767968238bf): created successfully Jul 03 01:20:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (133c12b1-bf5a-42dc-9c37-db284fe7082d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Flow 'volume_create_manager' (58361fc9-1d1c-46da-93f8-f0c73e3594cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:10 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-88f9927c-762c-496a-ad87-4b863c060428 tempest-ProjectReaderTests-1534071308 None] Created volume successfully. Jul 03 01:20:10 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1 1073741824" returned: 0 in 0.869s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:11 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1 Jul 03 01:20:11 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-66a9615f-bab7-4d53-9790-23d7a57886f3 tempest-ProjectReaderTests-1534071308 None] Acquiring lock "cinder-3ed37012-ee96-4c08-8adc-5767968238bf-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-66a9615f-bab7-4d53-9790-23d7a57886f3 tempest-ProjectReaderTests-1534071308 None] Lock "cinder-3ed37012-ee96-4c08-8adc-5767968238bf-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-66a9615f-bab7-4d53-9790-23d7a57886f3 tempest-ProjectReaderTests-1534071308 None] Acquiring lock "cinder-quobyte-3ed37012-ee96-4c08-8adc-5767968238bf" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-66a9615f-bab7-4d53-9790-23d7a57886f3 tempest-ProjectReaderTests-1534071308 None] Lock "cinder-quobyte-3ed37012-ee96-4c08-8adc-5767968238bf" acquired by "delete_volume" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:11 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b4c235-07a8-429d-9cf1-9fe70d57166e]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-66a9615f-bab7-4d53-9790-23d7a57886f3 tempest-ProjectReaderTests-1534071308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3ed37012-ee96-4c08-8adc-5767968238bf {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:11 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3ed37012-ee96-4c08-8adc-5767968238bf Jul 03 01:20:11 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:11 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1" returned: 0 in 0.720s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:20:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-90703381-c091-4263-a115-d191b15e0647 tempest-SnapshotDependencyTests-771684542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.760s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-90703381-c091-4263-a115-d191b15e0647 tempest-SnapshotDependencyTests-771684542 None] Creating offline snapshot ca86c5d1-67a7-4faf-acfd-01c1dba11a58 of volume 4ff43653-027a-433a-adac-7a30a93b7c48 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:20:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4908982-3cb0-44bb-8cf4-b89ce9b8efeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6f6af12-cf30-4272-adea-c87db5ff89a1', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed630ad-7763-4fa9-8e70-0929e5144c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:11 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dd956c-4c1c-484b-8eaf-29d807aaa2d3]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-90703381-c091-4263-a115-d191b15e0647 tempest-SnapshotDependencyTests-771684542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:11 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Volume volume-b6f6af12-cf30-4272-adea-c87db5ff89a1 (b6f6af12-cf30-4272-adea-c87db5ff89a1): created successfully Jul 03 01:20:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed630ad-7763-4fa9-8e70-0929e5144c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Flow 'volume_create_manager' (3eb1e934-3cbf-42b3-8662-8f8b64227c0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:11 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8f887258-416d-4c6a-888b-50271348d0d0 tempest-SnapshotMetadataTestJSON-1366185589 None] Created volume successfully. Jul 03 01:20:11 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48 Jul 03 01:20:11 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:12 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-66a9615f-bab7-4d53-9790-23d7a57886f3 tempest-ProjectReaderTests-1534071308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3ed37012-ee96-4c08-8adc-5767968238bf" returned: 0 in 0.802s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-66a9615f-bab7-4d53-9790-23d7a57886f3 tempest-ProjectReaderTests-1534071308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3ed37012-ee96-4c08-8adc-5767968238bf {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:12 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3ed37012-ee96-4c08-8adc-5767968238bf Jul 03 01:20:12 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:12 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-90703381-c091-4263-a115-d191b15e0647 tempest-SnapshotDependencyTests-771684542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48" returned: 0 in 0.790s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-90703381-c091-4263-a115-d191b15e0647 tempest-SnapshotDependencyTests-771684542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.ca86c5d1-67a7-4faf-acfd-01c1dba11a58 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:12 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.ca86c5d1-67a7-4faf-acfd-01c1dba11a58 1G Jul 03 01:20:12 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:20:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:12 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:20:12 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-94af6742-1864-4258-8162-dc6aa3939b81 tempest-SnapshotMetadataTestJSON-1366185589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:13 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-66a9615f-bab7-4d53-9790-23d7a57886f3 tempest-ProjectReaderTests-1534071308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3ed37012-ee96-4c08-8adc-5767968238bf" returned: 0 in 0.729s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-66a9615f-bab7-4d53-9790-23d7a57886f3 tempest-ProjectReaderTests-1534071308 None] Lock "cinder-quobyte-3ed37012-ee96-4c08-8adc-5767968238bf" released by "delete_volume" :: held 1.578s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:13 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-66a9615f-bab7-4d53-9790-23d7a57886f3 tempest-ProjectReaderTests-1534071308 None] Created reservations ['aab65715-bca0-4546-9485-68707e2faed6', '964d3526-e030-4143-8c5c-9b7350538a1a', 'e6d08ad7-5431-4db1-84eb-0265fefdad9b', 'ef64147f-d816-4035-828b-5298b489b8b2'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:20:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-66a9615f-bab7-4d53-9790-23d7a57886f3 tempest-ProjectReaderTests-1534071308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-66a9615f-bab7-4d53-9790-23d7a57886f3 tempest-ProjectReaderTests-1534071308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-66a9615f-bab7-4d53-9790-23d7a57886f3 tempest-ProjectReaderTests-1534071308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-66a9615f-bab7-4d53-9790-23d7a57886f3 tempest-ProjectReaderTests-1534071308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-66a9615f-bab7-4d53-9790-23d7a57886f3 tempest-ProjectReaderTests-1534071308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-66a9615f-bab7-4d53-9790-23d7a57886f3 tempest-ProjectReaderTests-1534071308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:13 devstack sudo[103505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:20:13 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:13 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-90703381-c091-4263-a115-d191b15e0647 tempest-SnapshotDependencyTests-771684542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.ca86c5d1-67a7-4faf-acfd-01c1dba11a58 1G" returned: 0 in 0.982s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-90703381-c091-4263-a115-d191b15e0647 tempest-SnapshotDependencyTests-771684542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ff43653-027a-433a-adac-7a30a93b7c48 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.ca86c5d1-67a7-4faf-acfd-01c1dba11a58 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:13 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ff43653-027a-433a-adac-7a30a93b7c48 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.ca86c5d1-67a7-4faf-acfd-01c1dba11a58 Jul 03 01:20:13 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:13 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.793s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:20:13 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:20:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 29 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:20:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:20:13 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-66a9615f-bab7-4d53-9790-23d7a57886f3 tempest-ProjectReaderTests-1534071308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.757s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-66a9615f-bab7-4d53-9790-23d7a57886f3 tempest-ProjectReaderTests-1534071308 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:20:13 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-66a9615f-bab7-4d53-9790-23d7a57886f3 tempest-ProjectReaderTests-1534071308 None] Deleted volume successfully. Jul 03 01:20:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-66a9615f-bab7-4d53-9790-23d7a57886f3 tempest-ProjectReaderTests-1534071308 None] Lock "cinder-3ed37012-ee96-4c08-8adc-5767968238bf-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:14 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:20:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Flow 'volume_create_manager' (e23829c0-016d-465d-b33f-c076f44b0e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f991707d-830f-4413-b116-cd11ab6dae36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f991707d-830f-4413-b116-cd11ab6dae36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-369293080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63fa95a6-2c76-4dfc-8cab-714b7be349a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8b04204cf14d89bfcb4f6350f0e77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:14Z,use_quota=True,user_id='4ec9623466ca4312bd1b53adfd5b7522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7638c306-9489-4fa4-b90a-febdbea63216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7638c306-9489-4fa4-b90a-febdbea63216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece7fb56-a3d2-4ae5-8337-02c0484f801a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece7fb56-a3d2-4ae5-8337-02c0484f801a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63fa95a6-2c76-4dfc-8cab-714b7be349a5', 'volume_name': 'volume-63fa95a6-2c76-4dfc-8cab-714b7be349a5', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5eae627-324e-458c-aeb1-77d75dcc06a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5eae627-324e-458c-aeb1-77d75dcc06a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc776100-a7ca-4748-ba11-50eeda1cc7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:14 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Volume 63fa95a6-2c76-4dfc-8cab-714b7be349a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63fa95a6-2c76-4dfc-8cab-714b7be349a5', 'volume_size': 1} Jul 03 01:20:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:14 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-90703381-c091-4263-a115-d191b15e0647 tempest-SnapshotDependencyTests-771684542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ff43653-027a-433a-adac-7a30a93b7c48 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.ca86c5d1-67a7-4faf-acfd-01c1dba11a58" returned: 0 in 0.924s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:14 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-90703381-c091-4263-a115-d191b15e0647 tempest-SnapshotDependencyTests-771684542 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.ca86c5d1-67a7-4faf-acfd-01c1dba11a58 is being set with open permissions: ugo+rw Jul 03 01:20:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-90703381-c091-4263-a115-d191b15e0647 tempest-SnapshotDependencyTests-771684542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.ca86c5d1-67a7-4faf-acfd-01c1dba11a58 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:14 devstack sudo[103518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.ca86c5d1-67a7-4faf-acfd-01c1dba11a58 Jul 03 01:20:14 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:15 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-90703381-c091-4263-a115-d191b15e0647 tempest-SnapshotDependencyTests-771684542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.ca86c5d1-67a7-4faf-acfd-01c1dba11a58" returned: 0 in 0.662s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-90703381-c091-4263-a115-d191b15e0647 tempest-SnapshotDependencyTests-771684542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:15 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.info Jul 03 01:20:15 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:15 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-90703381-c091-4263-a115-d191b15e0647 tempest-SnapshotDependencyTests-771684542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.info" returned: 0 in 0.651s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:15 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-90703381-c091-4263-a115-d191b15e0647 tempest-SnapshotDependencyTests-771684542 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.info is being set with open permissions: ugo+rw Jul 03 01:20:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-90703381-c091-4263-a115-d191b15e0647 tempest-SnapshotDependencyTests-771684542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:15 devstack sudo[103524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.info Jul 03 01:20:15 devstack sudo[103524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:16 devstack sudo[103524]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-90703381-c091-4263-a115-d191b15e0647 tempest-SnapshotDependencyTests-771684542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.info" returned: 0 in 0.634s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-90703381-c091-4263-a115-d191b15e0647 tempest-SnapshotDependencyTests-771684542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.767s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-94af6742-1864-4258-8162-dc6aa3939b81 tempest-SnapshotMetadataTestJSON-1366185589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.522s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-94af6742-1864-4258-8162-dc6aa3939b81 tempest-SnapshotMetadataTestJSON-1366185589 None] Creating offline snapshot 7339f0a2-7d42-4784-b434-ecce208bd0c2 of volume b6f6af12-cf30-4272-adea-c87db5ff89a1 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:20:16 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-90703381-c091-4263-a115-d191b15e0647 tempest-SnapshotDependencyTests-771684542 None] Create snapshot completed successfully Jul 03 01:20:16 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a389303e-876e-4b7d-9e49-cc322e895ea5]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-94af6742-1864-4258-8162-dc6aa3939b81 tempest-SnapshotMetadataTestJSON-1366185589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:16 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=110,cinder:INSERT=26,cinder:SELECT=71,cinder:DELETE=12 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:20:16 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1 Jul 03 01:20:16 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:17 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-94af6742-1864-4258-8162-dc6aa3939b81 tempest-SnapshotMetadataTestJSON-1366185589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1" returned: 0 in 0.825s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-94af6742-1864-4258-8162-dc6aa3939b81 tempest-SnapshotMetadataTestJSON-1366185589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.7339f0a2-7d42-4784-b434-ecce208bd0c2 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:17 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.7339f0a2-7d42-4784-b434-ecce208bd0c2 1G Jul 03 01:20:17 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:17 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:DELETE=9,cinder:SELECT=80,cinder:UPDATE=101,cinder:INSERT=25 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:20:17 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:20:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Flow 'volume_create_manager' (88370bc0-b7aa-41cc-a348-724db2a07992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a54adc0-f2e7-4f77-b44e-e42719f6a738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a54adc0-f2e7-4f77-b44e-e42719f6a738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e924448-0cc0-4abe-9a65-0f371698c429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f106c9d560714bf3a6caf70d87549c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ca86c5d1-67a7-4faf-acfd-01c1dba11a58,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:18Z,use_quota=True,user_id='44bec659f5504067b1712bf922a3a281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ffe59ab-9999-452d-a277-0fe5742e4fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ffe59ab-9999-452d-a277-0fe5742e4fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5456bd-7e60-402c-b39d-075bcb65a631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5456bd-7e60-402c-b39d-075bcb65a631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7e924448-0cc0-4abe-9a65-0f371698c429', 'volume_name': 'volume-7e924448-0cc0-4abe-9a65-0f371698c429', 'volume_size': 1, 'snapshot_id': 'ca86c5d1-67a7-4faf-acfd-01c1dba11a58'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (251054d2-9aae-4a98-8352-32c9c4f22724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (251054d2-9aae-4a98-8352-32c9c4f22724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb5d62b6-7c6a-4dd1-9c3b-e70e7db2eadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:18 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Volume 7e924448-0cc0-4abe-9a65-0f371698c429: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7e924448-0cc0-4abe-9a65-0f371698c429', 'volume_size': 1, 'snapshot_id': 'ca86c5d1-67a7-4faf-acfd-01c1dba11a58'} Jul 03 01:20:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:18 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-94af6742-1864-4258-8162-dc6aa3939b81 tempest-SnapshotMetadataTestJSON-1366185589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.7339f0a2-7d42-4784-b434-ecce208bd0c2 1G" returned: 0 in 0.901s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-94af6742-1864-4258-8162-dc6aa3939b81 tempest-SnapshotMetadataTestJSON-1366185589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f6af12-cf30-4272-adea-c87db5ff89a1 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.7339f0a2-7d42-4784-b434-ecce208bd0c2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:18 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f6af12-cf30-4272-adea-c87db5ff89a1 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.7339f0a2-7d42-4784-b434-ecce208bd0c2 Jul 03 01:20:18 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:18 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-94af6742-1864-4258-8162-dc6aa3939b81 tempest-SnapshotMetadataTestJSON-1366185589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f6af12-cf30-4272-adea-c87db5ff89a1 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.7339f0a2-7d42-4784-b434-ecce208bd0c2" returned: 0 in 0.706s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:18 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-94af6742-1864-4258-8162-dc6aa3939b81 tempest-SnapshotMetadataTestJSON-1366185589 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.7339f0a2-7d42-4784-b434-ecce208bd0c2 is being set with open permissions: ugo+rw Jul 03 01:20:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-94af6742-1864-4258-8162-dc6aa3939b81 tempest-SnapshotMetadataTestJSON-1366185589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.7339f0a2-7d42-4784-b434-ecce208bd0c2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:19 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.7339f0a2-7d42-4784-b434-ecce208bd0c2 Jul 03 01:20:19 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:19 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-94af6742-1864-4258-8162-dc6aa3939b81 tempest-SnapshotMetadataTestJSON-1366185589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.7339f0a2-7d42-4784-b434-ecce208bd0c2" returned: 0 in 0.677s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-94af6742-1864-4258-8162-dc6aa3939b81 tempest-SnapshotMetadataTestJSON-1366185589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:19 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.info Jul 03 01:20:19 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:20 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-94af6742-1864-4258-8162-dc6aa3939b81 tempest-SnapshotMetadataTestJSON-1366185589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.info" returned: 0 in 0.676s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:20 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-94af6742-1864-4258-8162-dc6aa3939b81 tempest-SnapshotMetadataTestJSON-1366185589 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.info is being set with open permissions: ugo+rw Jul 03 01:20:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-94af6742-1864-4258-8162-dc6aa3939b81 tempest-SnapshotMetadataTestJSON-1366185589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:20 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.info Jul 03 01:20:20 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:21 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-94af6742-1864-4258-8162-dc6aa3939b81 tempest-SnapshotMetadataTestJSON-1366185589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.info" returned: 0 in 0.638s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-94af6742-1864-4258-8162-dc6aa3939b81 tempest-SnapshotMetadataTestJSON-1366185589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.532s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.687s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-369293080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63fa95a6-2c76-4dfc-8cab-714b7be349a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8b04204cf14d89bfcb4f6350f0e77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:14Z,use_quota=True,user_id='4ec9623466ca4312bd1b53adfd5b7522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:20:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Creating volume 63fa95a6-2c76-4dfc-8cab-714b7be349a5 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:20:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:20:21 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:20:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-63fa95a6-2c76-4dfc-8cab-714b7be349a5 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:21 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-63fa95a6-2c76-4dfc-8cab-714b7be349a5 1073741824 Jul 03 01:20:21 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:21 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-94af6742-1864-4258-8162-dc6aa3939b81 tempest-SnapshotMetadataTestJSON-1366185589 None] Create snapshot completed successfully Jul 03 01:20:21 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-63fa95a6-2c76-4dfc-8cab-714b7be349a5 1073741824" returned: 0 in 0.947s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-adf691f2-eb32-4b9b-bae0-b8f3d315a437 tempest-SnapshotMetadataTestJSON-1366185589 None] Acquiring lock "cinder-7339f0a2-7d42-4784-b434-ecce208bd0c2-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-63fa95a6-2c76-4dfc-8cab-714b7be349a5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-adf691f2-eb32-4b9b-bae0-b8f3d315a437 tempest-SnapshotMetadataTestJSON-1366185589 None] Lock "cinder-7339f0a2-7d42-4784-b434-ecce208bd0c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-adf691f2-eb32-4b9b-bae0-b8f3d315a437 tempest-SnapshotMetadataTestJSON-1366185589 None] Acquiring lock "cinder-quobyte-b6f6af12-cf30-4272-adea-c87db5ff89a1" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:22 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-63fa95a6-2c76-4dfc-8cab-714b7be349a5 Jul 03 01:20:22 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-adf691f2-eb32-4b9b-bae0-b8f3d315a437 tempest-SnapshotMetadataTestJSON-1366185589 None] Lock "cinder-quobyte-b6f6af12-cf30-4272-adea-c87db5ff89a1" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-adf691f2-eb32-4b9b-bae0-b8f3d315a437 tempest-SnapshotMetadataTestJSON-1366185589 None] Acquiring lock "cinder-quobyte-7339f0a2-7d42-4784-b434-ecce208bd0c2" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-adf691f2-eb32-4b9b-bae0-b8f3d315a437 tempest-SnapshotMetadataTestJSON-1366185589 None] Lock "cinder-quobyte-7339f0a2-7d42-4784-b434-ecce208bd0c2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-adf691f2-eb32-4b9b-bae0-b8f3d315a437 tempest-SnapshotMetadataTestJSON-1366185589 None] Deleting offline snapshot 7339f0a2-7d42-4784-b434-ecce208bd0c2 of volume b6f6af12-cf30-4272-adea-c87db5ff89a1 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-adf691f2-eb32-4b9b-bae0-b8f3d315a437 tempest-SnapshotMetadataTestJSON-1366185589 None] snapshot_file for this snap is: volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.7339f0a2-7d42-4784-b434-ecce208bd0c2 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8714e763-a872-4c27-8716-b6af80cf0138]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-adf691f2-eb32-4b9b-bae0-b8f3d315a437 tempest-SnapshotMetadataTestJSON-1366185589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.7339f0a2-7d42-4784-b434-ecce208bd0c2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:22 devstack sudo[103604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.7339f0a2-7d42-4784-b434-ecce208bd0c2 Jul 03 01:20:22 devstack sudo[103604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:22 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-63fa95a6-2c76-4dfc-8cab-714b7be349a5" returned: 0 in 0.766s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.737s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Acquiring lock "cinder-quobyte-ca86c5d1-67a7-4faf-acfd-01c1dba11a58-7e924448-0cc0-4abe-9a65-0f371698c429" by "_create_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc776100-a7ca-4748-ba11-50eeda1cc7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63fa95a6-2c76-4dfc-8cab-714b7be349a5', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11968212-da6b-4fbd-902c-a2649f3eac47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Lock "cinder-quobyte-ca86c5d1-67a7-4faf-acfd-01c1dba11a58-7e924448-0cc0-4abe-9a65-0f371698c429" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Creating volume 7e924448-0cc0-4abe-9a65-0f371698c429 from snapshot ca86c5d1-67a7-4faf-acfd-01c1dba11a58 {{(pid=86772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Acquiring lock "cinder-quobyte-7e924448-0cc0-4abe-9a65-0f371698c429" by "_copy_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:22 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Volume volume-63fa95a6-2c76-4dfc-8cab-714b7be349a5 (63fa95a6-2c76-4dfc-8cab-714b7be349a5): created successfully Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11968212-da6b-4fbd-902c-a2649f3eac47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Flow 'volume_create_manager' (e23829c0-016d-465d-b33f-c076f44b0e80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Lock "cinder-quobyte-7e924448-0cc0-4abe-9a65-0f371698c429" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] snapshot: ca86c5d1-67a7-4faf-acfd-01c1dba11a58, volume: 7e924448-0cc0-4abe-9a65-0f371698c429, {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 01:20:22 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4e09a14f-98bd-40fc-9414-50c82a0c9b97 tempest-ProjectReaderTests-1534071308 None] Created volume successfully. Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b9c8a5-9d6e-42d1-9b3f-35045605c747]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.ca86c5d1-67a7-4faf-acfd-01c1dba11a58 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:23 devstack sudo[103604]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-adf691f2-eb32-4b9b-bae0-b8f3d315a437 tempest-SnapshotMetadataTestJSON-1366185589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.7339f0a2-7d42-4784-b434-ecce208bd0c2" returned: 0 in 0.879s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-adf691f2-eb32-4b9b-bae0-b8f3d315a437 tempest-SnapshotMetadataTestJSON-1366185589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6f6af12-cf30-4272-adea-c87db5ff89a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:20:23 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.ca86c5d1-67a7-4faf-acfd-01c1dba11a58 Jul 03 01:20:23 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:23 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff7ed7f-e36c-43a6-97ff-d55740e4355f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-adf691f2-eb32-4b9b-bae0-b8f3d315a437 tempest-SnapshotMetadataTestJSON-1366185589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-86473019-4e3f-491b-8c19-33930994581c req-06ce2a26-c2d4-4297-be94-5dfea4b59018 tempest-TestStampPattern-1880660764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:23 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1 Jul 03 01:20:23 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1ff1e655-dc44-482f-a3f1-0eba5503abac tempest-ProjectReaderTests-1534071308 None] Acquiring lock "cinder-63fa95a6-2c76-4dfc-8cab-714b7be349a5-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:23 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.ca86c5d1-67a7-4faf-acfd-01c1dba11a58" returned: 0 in 0.878s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ff43653-027a-433a-adac-7a30a93b7c48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:20:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48 {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 01:20:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Creating direct copy from snapshot {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 01:20:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1ff1e655-dc44-482f-a3f1-0eba5503abac tempest-ProjectReaderTests-1534071308 None] Lock "cinder-63fa95a6-2c76-4dfc-8cab-714b7be349a5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:23 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea4ad89-75e5-4865-82b9-6e834e9e1ab3]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1ff1e655-dc44-482f-a3f1-0eba5503abac tempest-ProjectReaderTests-1534071308 None] Acquiring lock "cinder-quobyte-63fa95a6-2c76-4dfc-8cab-714b7be349a5" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1ff1e655-dc44-482f-a3f1-0eba5503abac tempest-ProjectReaderTests-1534071308 None] Lock "cinder-quobyte-63fa95a6-2c76-4dfc-8cab-714b7be349a5" acquired by "delete_volume" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:23 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b62618-55b7-4171-b5c7-a91e0be3a6e3]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ff1e655-dc44-482f-a3f1-0eba5503abac tempest-ProjectReaderTests-1534071308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-63fa95a6-2c76-4dfc-8cab-714b7be349a5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:23 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-adf691f2-eb32-4b9b-bae0-b8f3d315a437 tempest-SnapshotMetadataTestJSON-1366185589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1" returned: 0 in 0.883s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-adf691f2-eb32-4b9b-bae0-b8f3d315a437 tempest-SnapshotMetadataTestJSON-1366185589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.7339f0a2-7d42-4784-b434-ecce208bd0c2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:23 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48 Jul 03 01:20:24 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:24 devstack sudo[103630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.7339f0a2-7d42-4784-b434-ecce208bd0c2 Jul 03 01:20:24 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:24 devstack sudo[103629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-63fa95a6-2c76-4dfc-8cab-714b7be349a5 Jul 03 01:20:24 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:24 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48" returned: 0 in 0.856s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:24 devstack cinder-volume[86772]: DEBUG cinder.utils [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Path /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7e924448-0cc0-4abe-9a65-0f371698c429 not found in is_blk_device check {{(pid=86772) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 01:20:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7e924448-0cc0-4abe-9a65-0f371698c429 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:24 devstack sudo[103646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7e924448-0cc0-4abe-9a65-0f371698c429 Jul 03 01:20:24 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:24 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-adf691f2-eb32-4b9b-bae0-b8f3d315a437 tempest-SnapshotMetadataTestJSON-1366185589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.7339f0a2-7d42-4784-b434-ecce208bd0c2" returned: 0 in 0.797s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-adf691f2-eb32-4b9b-bae0-b8f3d315a437 tempest-SnapshotMetadataTestJSON-1366185589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.7339f0a2-7d42-4784-b434-ecce208bd0c2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:24 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ff1e655-dc44-482f-a3f1-0eba5503abac tempest-ProjectReaderTests-1534071308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-63fa95a6-2c76-4dfc-8cab-714b7be349a5" returned: 0 in 0.840s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ff1e655-dc44-482f-a3f1-0eba5503abac tempest-ProjectReaderTests-1534071308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-63fa95a6-2c76-4dfc-8cab-714b7be349a5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:24 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.7339f0a2-7d42-4784-b434-ecce208bd0c2 Jul 03 01:20:24 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:24 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-63fa95a6-2c76-4dfc-8cab-714b7be349a5 Jul 03 01:20:24 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:25 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ff1e655-dc44-482f-a3f1-0eba5503abac tempest-ProjectReaderTests-1534071308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-63fa95a6-2c76-4dfc-8cab-714b7be349a5" returned: 0 in 0.649s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1ff1e655-dc44-482f-a3f1-0eba5503abac tempest-ProjectReaderTests-1534071308 None] Lock "cinder-quobyte-63fa95a6-2c76-4dfc-8cab-714b7be349a5" released by "delete_volume" :: held 1.533s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:25 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-1ff1e655-dc44-482f-a3f1-0eba5503abac tempest-ProjectReaderTests-1534071308 None] Created reservations ['b3f9b38d-c980-4559-8a5a-4149051dac38', 'c895c1ba-060a-47f7-97bc-6d6a838fd59c', '3a34e2ea-2f08-49bc-a25d-9007b4f2d3f3', 'fc0eb894-b397-4773-a7cd-0765df778dc3'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:20:25 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-adf691f2-eb32-4b9b-bae0-b8f3d315a437 tempest-SnapshotMetadataTestJSON-1366185589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1.7339f0a2-7d42-4784-b434-ecce208bd0c2" returned: 0 in 0.763s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-adf691f2-eb32-4b9b-bae0-b8f3d315a437 tempest-SnapshotMetadataTestJSON-1366185589 None] Lock "cinder-quobyte-7339f0a2-7d42-4784-b434-ecce208bd0c2" released by "_delete_snapshot" :: held 3.481s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-adf691f2-eb32-4b9b-bae0-b8f3d315a437 tempest-SnapshotMetadataTestJSON-1366185589 None] Lock "cinder-quobyte-b6f6af12-cf30-4272-adea-c87db5ff89a1" released by "delete_snapshot" :: held 3.516s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1ff1e655-dc44-482f-a3f1-0eba5503abac tempest-ProjectReaderTests-1534071308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1ff1e655-dc44-482f-a3f1-0eba5503abac tempest-ProjectReaderTests-1534071308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1ff1e655-dc44-482f-a3f1-0eba5503abac tempest-ProjectReaderTests-1534071308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1ff1e655-dc44-482f-a3f1-0eba5503abac tempest-ProjectReaderTests-1534071308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1ff1e655-dc44-482f-a3f1-0eba5503abac tempest-ProjectReaderTests-1534071308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ff1e655-dc44-482f-a3f1-0eba5503abac tempest-ProjectReaderTests-1534071308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:25 devstack sudo[103670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:20:25 devstack sudo[103670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:25 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-adf691f2-eb32-4b9b-bae0-b8f3d315a437 tempest-SnapshotMetadataTestJSON-1366185589 None] Created reservations ['2bf262f8-0d7c-4de4-aed3-b6f0ac2d2263', 'e45f050c-c2b5-478f-8986-5318e0e29d9f', '24c5c933-6ff4-4384-b85c-cd0591a144f2', '814e5244-81dd-4a78-89ab-aad613a761c9'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:20:26 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-adf691f2-eb32-4b9b-bae0-b8f3d315a437 tempest-SnapshotMetadataTestJSON-1366185589 None] Delete snapshot completed successfully. Jul 03 01:20:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-adf691f2-eb32-4b9b-bae0-b8f3d315a437 tempest-SnapshotMetadataTestJSON-1366185589 None] Lock "cinder-7339f0a2-7d42-4784-b434-ecce208bd0c2-delete_snapshot" released by "delete_snapshot" :: held 3.958s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-503234f9-f248-47bc-b364-b4fabce69fcd tempest-SnapshotMetadataTestJSON-1366185589 None] Acquiring lock "cinder-b6f6af12-cf30-4272-adea-c87db5ff89a1-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-503234f9-f248-47bc-b364-b4fabce69fcd tempest-SnapshotMetadataTestJSON-1366185589 None] Lock "cinder-b6f6af12-cf30-4272-adea-c87db5ff89a1-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-503234f9-f248-47bc-b364-b4fabce69fcd tempest-SnapshotMetadataTestJSON-1366185589 None] Acquiring lock "cinder-quobyte-b6f6af12-cf30-4272-adea-c87db5ff89a1" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-503234f9-f248-47bc-b364-b4fabce69fcd tempest-SnapshotMetadataTestJSON-1366185589 None] Lock "cinder-quobyte-b6f6af12-cf30-4272-adea-c87db5ff89a1" acquired by "delete_volume" :: waited 0.049s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:27 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2c76e1-f2c4-478f-990e-aa3b591cd5f6]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-503234f9-f248-47bc-b364-b4fabce69fcd tempest-SnapshotMetadataTestJSON-1366185589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:27 devstack sudo[103670]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1ff1e655-dc44-482f-a3f1-0eba5503abac tempest-ProjectReaderTests-1534071308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.982s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:27 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-1ff1e655-dc44-482f-a3f1-0eba5503abac tempest-ProjectReaderTests-1534071308 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:20:27 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1ff1e655-dc44-482f-a3f1-0eba5503abac tempest-ProjectReaderTests-1534071308 None] Deleted volume successfully. Jul 03 01:20:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1ff1e655-dc44-482f-a3f1-0eba5503abac tempest-ProjectReaderTests-1534071308 None] Lock "cinder-63fa95a6-2c76-4dfc-8cab-714b7be349a5-delete_volume" released by "delete_volume" :: held 3.876s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:27 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1 Jul 03 01:20:27 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:29 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-503234f9-f248-47bc-b364-b4fabce69fcd tempest-SnapshotMetadataTestJSON-1366185589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1" returned: 0 in 1.894s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-503234f9-f248-47bc-b364-b4fabce69fcd tempest-SnapshotMetadataTestJSON-1366185589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:29 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1 Jul 03 01:20:29 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:30 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7e924448-0cc0-4abe-9a65-0f371698c429" returned: 0 in 6.135s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:30 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce41f366-7ae3-41c2-84ae-85512c68ff5a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:31 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48 Jul 03 01:20:31 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:31 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-503234f9-f248-47bc-b364-b4fabce69fcd tempest-SnapshotMetadataTestJSON-1366185589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b6f6af12-cf30-4272-adea-c87db5ff89a1" returned: 0 in 1.640s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-503234f9-f248-47bc-b364-b4fabce69fcd tempest-SnapshotMetadataTestJSON-1366185589 None] Lock "cinder-quobyte-b6f6af12-cf30-4272-adea-c87db5ff89a1" released by "delete_volume" :: held 3.691s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:31 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-503234f9-f248-47bc-b364-b4fabce69fcd tempest-SnapshotMetadataTestJSON-1366185589 None] Created reservations ['ad6bbf0a-3c07-4034-81fe-2b6dedca5add', '2b5ab840-76dd-4dbd-89c8-d6fe02f32bf4', 'a770d3bd-d3d2-47f4-9df7-0f9b43994ea7', 'b25e01a2-a10a-494c-b883-a174e00dbf15'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:20:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-503234f9-f248-47bc-b364-b4fabce69fcd tempest-SnapshotMetadataTestJSON-1366185589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-503234f9-f248-47bc-b364-b4fabce69fcd tempest-SnapshotMetadataTestJSON-1366185589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-503234f9-f248-47bc-b364-b4fabce69fcd tempest-SnapshotMetadataTestJSON-1366185589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-503234f9-f248-47bc-b364-b4fabce69fcd tempest-SnapshotMetadataTestJSON-1366185589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-503234f9-f248-47bc-b364-b4fabce69fcd tempest-SnapshotMetadataTestJSON-1366185589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-503234f9-f248-47bc-b364-b4fabce69fcd tempest-SnapshotMetadataTestJSON-1366185589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:31 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:20:31 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:31 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48" returned: 0 in 1.022s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:31 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Image conversion details: src /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7e924448-0cc0-4abe-9a65-0f371698c429 {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:20:31 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Converted 1024.00 MB image at 166.89 MB/s Jul 03 01:20:31 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7e924448-0cc0-4abe-9a65-0f371698c429 is being set with open permissions: ugo+rw Jul 03 01:20:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7e924448-0cc0-4abe-9a65-0f371698c429 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:31 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7e924448-0cc0-4abe-9a65-0f371698c429 Jul 03 01:20:31 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:32 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-503234f9-f248-47bc-b364-b4fabce69fcd tempest-SnapshotMetadataTestJSON-1366185589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.783s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:32 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-503234f9-f248-47bc-b364-b4fabce69fcd tempest-SnapshotMetadataTestJSON-1366185589 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:20:32 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-503234f9-f248-47bc-b364-b4fabce69fcd tempest-SnapshotMetadataTestJSON-1366185589 None] Deleted volume successfully. Jul 03 01:20:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-503234f9-f248-47bc-b364-b4fabce69fcd tempest-SnapshotMetadataTestJSON-1366185589 None] Lock "cinder-b6f6af12-cf30-4272-adea-c87db5ff89a1-delete_volume" released by "delete_volume" :: held 4.843s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:32 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7e924448-0cc0-4abe-9a65-0f371698c429" returned: 0 in 0.707s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Lock "cinder-quobyte-7e924448-0cc0-4abe-9a65-0f371698c429" released by "_copy_volume_from_snapshot" :: held 9.729s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Lock "cinder-quobyte-ca86c5d1-67a7-4faf-acfd-01c1dba11a58-7e924448-0cc0-4abe-9a65-0f371698c429" released by "_create_volume_from_snapshot" :: held 9.787s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.826s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-86473019-4e3f-491b-8c19-33930994581c req-06ce2a26-c2d4-4297-be94-5dfea4b59018 tempest-TestStampPattern-1880660764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.510s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:32 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8855faf-2969-4d0a-9a49-b802fc7e74f2]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-86473019-4e3f-491b-8c19-33930994581c req-06ce2a26-c2d4-4297-be94-5dfea4b59018 tempest-TestStampPattern-1880660764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e746818-315d-4866-a072-0b298f025bca {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb5d62b6-7c6a-4dd1-9c3b-e70e7db2eadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e924448-0cc0-4abe-9a65-0f371698c429', 'volume_size': 1, 'snapshot_id': 'ca86c5d1-67a7-4faf-acfd-01c1dba11a58'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e5c6d4-2792-45ea-abc7-d1708bf7136b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:32 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Volume volume-7e924448-0cc0-4abe-9a65-0f371698c429 (7e924448-0cc0-4abe-9a65-0f371698c429): created successfully Jul 03 01:20:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e5c6d4-2792-45ea-abc7-d1708bf7136b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Flow 'volume_create_manager' (88370bc0-b7aa-41cc-a348-724db2a07992) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:32 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-2f8425d6-c781-4909-86f0-47f2a4622961 tempest-SnapshotDependencyTests-771684542 None] Created volume successfully. Jul 03 01:20:32 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e746818-315d-4866-a072-0b298f025bca Jul 03 01:20:32 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:33 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-86473019-4e3f-491b-8c19-33930994581c req-06ce2a26-c2d4-4297-be94-5dfea4b59018 tempest-TestStampPattern-1880660764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e746818-315d-4866-a072-0b298f025bca" returned: 0 in 0.939s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-86473019-4e3f-491b-8c19-33930994581c req-06ce2a26-c2d4-4297-be94-5dfea4b59018 tempest-TestStampPattern-1880660764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.982s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-30ec5d21-5b81-4a4f-bb2c-f92bc8d35bbb tempest-SnapshotDependencyTests-771684542 None] Acquiring lock "cinder-ca86c5d1-67a7-4faf-acfd-01c1dba11a58-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-86473019-4e3f-491b-8c19-33930994581c req-06ce2a26-c2d4-4297-be94-5dfea4b59018 tempest-TestStampPattern-1880660764 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171', 'name': 'volume-5e746818-315d-4866-a072-0b298f025bca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d1fac2c-8c14-4244-aea1-c84c55324a1a', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:20:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-30ec5d21-5b81-4a4f-bb2c-f92bc8d35bbb tempest-SnapshotDependencyTests-771684542 None] Lock "cinder-ca86c5d1-67a7-4faf-acfd-01c1dba11a58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-30ec5d21-5b81-4a4f-bb2c-f92bc8d35bbb tempest-SnapshotDependencyTests-771684542 None] Acquiring lock "cinder-quobyte-4ff43653-027a-433a-adac-7a30a93b7c48" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-30ec5d21-5b81-4a4f-bb2c-f92bc8d35bbb tempest-SnapshotDependencyTests-771684542 None] Lock "cinder-quobyte-4ff43653-027a-433a-adac-7a30a93b7c48" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-30ec5d21-5b81-4a4f-bb2c-f92bc8d35bbb tempest-SnapshotDependencyTests-771684542 None] Acquiring lock "cinder-quobyte-ca86c5d1-67a7-4faf-acfd-01c1dba11a58" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-30ec5d21-5b81-4a4f-bb2c-f92bc8d35bbb tempest-SnapshotDependencyTests-771684542 None] Lock "cinder-quobyte-ca86c5d1-67a7-4faf-acfd-01c1dba11a58" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-30ec5d21-5b81-4a4f-bb2c-f92bc8d35bbb tempest-SnapshotDependencyTests-771684542 None] Deleting offline snapshot ca86c5d1-67a7-4faf-acfd-01c1dba11a58 of volume 4ff43653-027a-433a-adac-7a30a93b7c48 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:20:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-30ec5d21-5b81-4a4f-bb2c-f92bc8d35bbb tempest-SnapshotDependencyTests-771684542 None] snapshot_file for this snap is: volume-4ff43653-027a-433a-adac-7a30a93b7c48.ca86c5d1-67a7-4faf-acfd-01c1dba11a58 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:20:33 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[744b4b1c-5244-45f9-93e1-89688952f5b6]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-30ec5d21-5b81-4a4f-bb2c-f92bc8d35bbb tempest-SnapshotDependencyTests-771684542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.ca86c5d1-67a7-4faf-acfd-01c1dba11a58 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:33 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-86473019-4e3f-491b-8c19-33930994581c req-06ce2a26-c2d4-4297-be94-5dfea4b59018 tempest-TestStampPattern-1880660764 None] attachment_update completed successfully. Jul 03 01:20:33 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.ca86c5d1-67a7-4faf-acfd-01c1dba11a58 Jul 03 01:20:33 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:34 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-30ec5d21-5b81-4a4f-bb2c-f92bc8d35bbb tempest-SnapshotDependencyTests-771684542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.ca86c5d1-67a7-4faf-acfd-01c1dba11a58" returned: 0 in 0.874s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-30ec5d21-5b81-4a4f-bb2c-f92bc8d35bbb tempest-SnapshotDependencyTests-771684542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ff43653-027a-433a-adac-7a30a93b7c48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:20:34 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[655bcc97-f905-45a1-ae8a-af9d4f71cdcf]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-30ec5d21-5b81-4a4f-bb2c-f92bc8d35bbb tempest-SnapshotDependencyTests-771684542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:34 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48 Jul 03 01:20:34 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:35 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-30ec5d21-5b81-4a4f-bb2c-f92bc8d35bbb tempest-SnapshotDependencyTests-771684542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48" returned: 0 in 0.812s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-30ec5d21-5b81-4a4f-bb2c-f92bc8d35bbb tempest-SnapshotDependencyTests-771684542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.ca86c5d1-67a7-4faf-acfd-01c1dba11a58 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:35 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.ca86c5d1-67a7-4faf-acfd-01c1dba11a58 Jul 03 01:20:35 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Flow 'volume_create_manager' (3a96fa47-f0cb-4096-9bf7-f300d2cb5285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99164a75-5743-4bda-a162-6e03de4b090c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99164a75-5743-4bda-a162-6e03de4b090c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-563365831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d99ffc0e-7f7e-467c-a58d-f85edfa43514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c8ad3fc47946ec9f4029df7f7962ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:36Z,use_quota=True,user_id='180bd8b8d948458282cf831a9d37a100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c002e08a-995c-465f-8404-99886ae06c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c002e08a-995c-465f-8404-99886ae06c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8315a6-5061-42db-8858-12eec3feadcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8315a6-5061-42db-8858-12eec3feadcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd99ffc0e-7f7e-467c-a58d-f85edfa43514', 'volume_name': 'volume-d99ffc0e-7f7e-467c-a58d-f85edfa43514', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c63d6f6-3fce-4b8e-ab69-62ee1f4c9209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c63d6f6-3fce-4b8e-ab69-62ee1f4c9209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b8e456-f95f-4abc-b933-fd97564063c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:36 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Volume d99ffc0e-7f7e-467c-a58d-f85edfa43514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d99ffc0e-7f7e-467c-a58d-f85edfa43514', 'volume_size': 1} Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-563365831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d99ffc0e-7f7e-467c-a58d-f85edfa43514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c8ad3fc47946ec9f4029df7f7962ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:36Z,use_quota=True,user_id='180bd8b8d948458282cf831a9d37a100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Creating volume d99ffc0e-7f7e-467c-a58d-f85edfa43514 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:20:36 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d99ffc0e-7f7e-467c-a58d-f85edfa43514 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:36 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d99ffc0e-7f7e-467c-a58d-f85edfa43514 1073741824 Jul 03 01:20:36 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:36 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-30ec5d21-5b81-4a4f-bb2c-f92bc8d35bbb tempest-SnapshotDependencyTests-771684542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.ca86c5d1-67a7-4faf-acfd-01c1dba11a58" returned: 0 in 0.745s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-30ec5d21-5b81-4a4f-bb2c-f92bc8d35bbb tempest-SnapshotDependencyTests-771684542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.ca86c5d1-67a7-4faf-acfd-01c1dba11a58 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:36 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.ca86c5d1-67a7-4faf-acfd-01c1dba11a58 Jul 03 01:20:36 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:36 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-30ec5d21-5b81-4a4f-bb2c-f92bc8d35bbb tempest-SnapshotDependencyTests-771684542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48.ca86c5d1-67a7-4faf-acfd-01c1dba11a58" returned: 0 in 0.666s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-30ec5d21-5b81-4a4f-bb2c-f92bc8d35bbb tempest-SnapshotDependencyTests-771684542 None] Lock "cinder-quobyte-ca86c5d1-67a7-4faf-acfd-01c1dba11a58" released by "_delete_snapshot" :: held 3.222s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-30ec5d21-5b81-4a4f-bb2c-f92bc8d35bbb tempest-SnapshotDependencyTests-771684542 None] Lock "cinder-quobyte-4ff43653-027a-433a-adac-7a30a93b7c48" released by "delete_snapshot" :: held 3.258s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:37 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d99ffc0e-7f7e-467c-a58d-f85edfa43514 1073741824" returned: 0 in 0.857s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d99ffc0e-7f7e-467c-a58d-f85edfa43514 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:37 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-30ec5d21-5b81-4a4f-bb2c-f92bc8d35bbb tempest-SnapshotDependencyTests-771684542 None] Created reservations ['4ba87c0d-361f-4362-9f3a-5ec5abfda726', 'f8ea9f2b-27d1-486c-9f96-902d6de8259e', 'a2912ae8-1a33-4d36-a264-bba2fc856c6b', 'fe0fcf5f-8ec8-44ac-bb81-be66c0e63ecb'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:20:37 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d99ffc0e-7f7e-467c-a58d-f85edfa43514 Jul 03 01:20:37 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:37 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-30ec5d21-5b81-4a4f-bb2c-f92bc8d35bbb tempest-SnapshotDependencyTests-771684542 None] Delete snapshot completed successfully. Jul 03 01:20:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-30ec5d21-5b81-4a4f-bb2c-f92bc8d35bbb tempest-SnapshotDependencyTests-771684542 None] Lock "cinder-ca86c5d1-67a7-4faf-acfd-01c1dba11a58-delete_snapshot" released by "delete_snapshot" :: held 3.489s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:37 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d99ffc0e-7f7e-467c-a58d-f85edfa43514" returned: 0 in 0.726s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:20:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b8e456-f95f-4abc-b933-fd97564063c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d99ffc0e-7f7e-467c-a58d-f85edfa43514', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5599eb95-bbb8-4352-9c61-c105fd9821f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:37 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Volume volume-d99ffc0e-7f7e-467c-a58d-f85edfa43514 (d99ffc0e-7f7e-467c-a58d-f85edfa43514): created successfully Jul 03 01:20:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5599eb95-bbb8-4352-9c61-c105fd9821f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Flow 'volume_create_manager' (3a96fa47-f0cb-4096-9bf7-f300d2cb5285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:37 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-13708501-6498-4b5e-a421-69fc06c4f8f3 tempest-AbsoluteLimitsTests-632486922 None] Created volume successfully. Jul 03 01:20:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4da6b1ef-2aa6-4cfa-ad88-e6e49a85dc3e tempest-SnapshotDependencyTests-771684542 None] Acquiring lock "cinder-4ff43653-027a-433a-adac-7a30a93b7c48-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4da6b1ef-2aa6-4cfa-ad88-e6e49a85dc3e tempest-SnapshotDependencyTests-771684542 None] Lock "cinder-4ff43653-027a-433a-adac-7a30a93b7c48-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4da6b1ef-2aa6-4cfa-ad88-e6e49a85dc3e tempest-SnapshotDependencyTests-771684542 None] Acquiring lock "cinder-quobyte-4ff43653-027a-433a-adac-7a30a93b7c48" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4da6b1ef-2aa6-4cfa-ad88-e6e49a85dc3e tempest-SnapshotDependencyTests-771684542 None] Lock "cinder-quobyte-4ff43653-027a-433a-adac-7a30a93b7c48" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:38 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[365c7819-2367-4f07-83f6-6138b73af09a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4da6b1ef-2aa6-4cfa-ad88-e6e49a85dc3e tempest-SnapshotDependencyTests-771684542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:38 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48 Jul 03 01:20:38 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1b44b02e-d890-49e2-bd34-85a905033549 tempest-AbsoluteLimitsTests-632486922 None] Acquiring lock "cinder-d99ffc0e-7f7e-467c-a58d-f85edfa43514-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1b44b02e-d890-49e2-bd34-85a905033549 tempest-AbsoluteLimitsTests-632486922 None] Lock "cinder-d99ffc0e-7f7e-467c-a58d-f85edfa43514-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1b44b02e-d890-49e2-bd34-85a905033549 tempest-AbsoluteLimitsTests-632486922 None] Acquiring lock "cinder-quobyte-d99ffc0e-7f7e-467c-a58d-f85edfa43514" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1b44b02e-d890-49e2-bd34-85a905033549 tempest-AbsoluteLimitsTests-632486922 None] Lock "cinder-quobyte-d99ffc0e-7f7e-467c-a58d-f85edfa43514" acquired by "delete_volume" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:38 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2454a92d-6ce1-4f40-ba4b-847eddf81a06]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1b44b02e-d890-49e2-bd34-85a905033549 tempest-AbsoluteLimitsTests-632486922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d99ffc0e-7f7e-467c-a58d-f85edfa43514 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:38 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d99ffc0e-7f7e-467c-a58d-f85edfa43514 Jul 03 01:20:38 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:39 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4da6b1ef-2aa6-4cfa-ad88-e6e49a85dc3e tempest-SnapshotDependencyTests-771684542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48" returned: 0 in 0.981s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4da6b1ef-2aa6-4cfa-ad88-e6e49a85dc3e tempest-SnapshotDependencyTests-771684542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:39 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48 Jul 03 01:20:39 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:39 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1b44b02e-d890-49e2-bd34-85a905033549 tempest-AbsoluteLimitsTests-632486922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d99ffc0e-7f7e-467c-a58d-f85edfa43514" returned: 0 in 0.861s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1b44b02e-d890-49e2-bd34-85a905033549 tempest-AbsoluteLimitsTests-632486922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d99ffc0e-7f7e-467c-a58d-f85edfa43514 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:39 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d99ffc0e-7f7e-467c-a58d-f85edfa43514 Jul 03 01:20:39 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:39 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4da6b1ef-2aa6-4cfa-ad88-e6e49a85dc3e tempest-SnapshotDependencyTests-771684542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4ff43653-027a-433a-adac-7a30a93b7c48" returned: 0 in 0.787s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4da6b1ef-2aa6-4cfa-ad88-e6e49a85dc3e tempest-SnapshotDependencyTests-771684542 None] Lock "cinder-quobyte-4ff43653-027a-433a-adac-7a30a93b7c48" released by "delete_volume" :: held 1.828s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:39 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-4da6b1ef-2aa6-4cfa-ad88-e6e49a85dc3e tempest-SnapshotDependencyTests-771684542 None] Created reservations ['9296771c-d8c5-4d41-bf11-a0736a180c5d', '78649441-ecd2-49ae-a91d-76020d19c873', '74a6fe17-15c6-42e6-9c03-1814f548f35a', '194a20a3-9180-46ec-a0ab-14ee9ebd7f02'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:20:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4da6b1ef-2aa6-4cfa-ad88-e6e49a85dc3e tempest-SnapshotDependencyTests-771684542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4da6b1ef-2aa6-4cfa-ad88-e6e49a85dc3e tempest-SnapshotDependencyTests-771684542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4da6b1ef-2aa6-4cfa-ad88-e6e49a85dc3e tempest-SnapshotDependencyTests-771684542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4da6b1ef-2aa6-4cfa-ad88-e6e49a85dc3e tempest-SnapshotDependencyTests-771684542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4da6b1ef-2aa6-4cfa-ad88-e6e49a85dc3e tempest-SnapshotDependencyTests-771684542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4da6b1ef-2aa6-4cfa-ad88-e6e49a85dc3e tempest-SnapshotDependencyTests-771684542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:39 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:20:39 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:40 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1b44b02e-d890-49e2-bd34-85a905033549 tempest-AbsoluteLimitsTests-632486922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-d99ffc0e-7f7e-467c-a58d-f85edfa43514" returned: 0 in 0.708s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1b44b02e-d890-49e2-bd34-85a905033549 tempest-AbsoluteLimitsTests-632486922 None] Lock "cinder-quobyte-d99ffc0e-7f7e-467c-a58d-f85edfa43514" released by "delete_volume" :: held 1.625s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:40 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-1b44b02e-d890-49e2-bd34-85a905033549 tempest-AbsoluteLimitsTests-632486922 None] Created reservations ['b45018ae-dfa3-4123-b437-5d0008c60cb4', '8de3dc06-d20a-438f-a2fa-f0efaa587d12', '885d3f4a-78cf-4c85-8b03-fc047271bd78', 'dfdb9ef6-dda5-4a2a-bb6b-b5f622f2914c'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:20:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77266c6c-9569-4564-9266-29914f6ba3ef tempest-SnapshotDependencyTests-771684542 None] Acquiring lock "cinder-7e924448-0cc0-4abe-9a65-0f371698c429-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1b44b02e-d890-49e2-bd34-85a905033549 tempest-AbsoluteLimitsTests-632486922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1b44b02e-d890-49e2-bd34-85a905033549 tempest-AbsoluteLimitsTests-632486922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1b44b02e-d890-49e2-bd34-85a905033549 tempest-AbsoluteLimitsTests-632486922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1b44b02e-d890-49e2-bd34-85a905033549 tempest-AbsoluteLimitsTests-632486922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1b44b02e-d890-49e2-bd34-85a905033549 tempest-AbsoluteLimitsTests-632486922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1b44b02e-d890-49e2-bd34-85a905033549 tempest-AbsoluteLimitsTests-632486922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77266c6c-9569-4564-9266-29914f6ba3ef tempest-SnapshotDependencyTests-771684542 None] Lock "cinder-7e924448-0cc0-4abe-9a65-0f371698c429-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:40 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:20:40 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77266c6c-9569-4564-9266-29914f6ba3ef tempest-SnapshotDependencyTests-771684542 None] Acquiring lock "cinder-quobyte-7e924448-0cc0-4abe-9a65-0f371698c429" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77266c6c-9569-4564-9266-29914f6ba3ef tempest-SnapshotDependencyTests-771684542 None] Lock "cinder-quobyte-7e924448-0cc0-4abe-9a65-0f371698c429" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:40 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cda9336-1621-4a8b-b954-94eb7f6b35e9]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77266c6c-9569-4564-9266-29914f6ba3ef tempest-SnapshotDependencyTests-771684542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7e924448-0cc0-4abe-9a65-0f371698c429 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:40 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7e924448-0cc0-4abe-9a65-0f371698c429 Jul 03 01:20:40 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:40 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4da6b1ef-2aa6-4cfa-ad88-e6e49a85dc3e tempest-SnapshotDependencyTests-771684542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.864s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:40 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-4da6b1ef-2aa6-4cfa-ad88-e6e49a85dc3e tempest-SnapshotDependencyTests-771684542 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:20:40 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4da6b1ef-2aa6-4cfa-ad88-e6e49a85dc3e tempest-SnapshotDependencyTests-771684542 None] Deleted volume successfully. Jul 03 01:20:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4da6b1ef-2aa6-4cfa-ad88-e6e49a85dc3e tempest-SnapshotDependencyTests-771684542 None] Lock "cinder-4ff43653-027a-433a-adac-7a30a93b7c48-delete_volume" released by "delete_volume" :: held 2.930s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:41 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1b44b02e-d890-49e2-bd34-85a905033549 tempest-AbsoluteLimitsTests-632486922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.873s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:41 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-1b44b02e-d890-49e2-bd34-85a905033549 tempest-AbsoluteLimitsTests-632486922 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:20:41 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1b44b02e-d890-49e2-bd34-85a905033549 tempest-AbsoluteLimitsTests-632486922 None] Deleted volume successfully. Jul 03 01:20:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1b44b02e-d890-49e2-bd34-85a905033549 tempest-AbsoluteLimitsTests-632486922 None] Lock "cinder-d99ffc0e-7f7e-467c-a58d-f85edfa43514-delete_volume" released by "delete_volume" :: held 2.805s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:41 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-87c3b78c-bc52-4cb6-a685-78bd73195bdc req-83cb7280-79e1-467d-8a86-8499d4dfdbd8 tempest-TestStampPattern-1880660764 None] Terminate volume connection completed successfully. Jul 03 01:20:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-87c3b78c-bc52-4cb6-a685-78bd73195bdc req-83cb7280-79e1-467d-8a86-8499d4dfdbd8 tempest-TestStampPattern-1880660764 None] Deleting attachment 9d1fac2c-8c14-4244-aea1-c84c55324a1a. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:20:41 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77266c6c-9569-4564-9266-29914f6ba3ef tempest-SnapshotDependencyTests-771684542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7e924448-0cc0-4abe-9a65-0f371698c429" returned: 0 in 0.952s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77266c6c-9569-4564-9266-29914f6ba3ef tempest-SnapshotDependencyTests-771684542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7e924448-0cc0-4abe-9a65-0f371698c429 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:41 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7e924448-0cc0-4abe-9a65-0f371698c429 Jul 03 01:20:41 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:41 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77266c6c-9569-4564-9266-29914f6ba3ef tempest-SnapshotDependencyTests-771684542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7e924448-0cc0-4abe-9a65-0f371698c429" returned: 0 in 0.657s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77266c6c-9569-4564-9266-29914f6ba3ef tempest-SnapshotDependencyTests-771684542 None] Lock "cinder-quobyte-7e924448-0cc0-4abe-9a65-0f371698c429" released by "delete_volume" :: held 1.662s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:42 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-77266c6c-9569-4564-9266-29914f6ba3ef tempest-SnapshotDependencyTests-771684542 None] Created reservations ['4ad51cf1-ae2f-4cb5-bec7-200a9e5562b3', 'c897097e-acb3-419e-984e-8fd4b254593a', '0aa3d9f8-3d76-44d1-8ed9-fdcb05a157bc', '8fd57051-4417-40e6-a403-6d200ca0e65e'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:20:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-77266c6c-9569-4564-9266-29914f6ba3ef tempest-SnapshotDependencyTests-771684542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-77266c6c-9569-4564-9266-29914f6ba3ef tempest-SnapshotDependencyTests-771684542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-77266c6c-9569-4564-9266-29914f6ba3ef tempest-SnapshotDependencyTests-771684542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-77266c6c-9569-4564-9266-29914f6ba3ef tempest-SnapshotDependencyTests-771684542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-77266c6c-9569-4564-9266-29914f6ba3ef tempest-SnapshotDependencyTests-771684542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77266c6c-9569-4564-9266-29914f6ba3ef tempest-SnapshotDependencyTests-771684542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:42 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:20:42 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:42 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-77266c6c-9569-4564-9266-29914f6ba3ef tempest-SnapshotDependencyTests-771684542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.742s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:42 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-77266c6c-9569-4564-9266-29914f6ba3ef tempest-SnapshotDependencyTests-771684542 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:20:42 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-77266c6c-9569-4564-9266-29914f6ba3ef tempest-SnapshotDependencyTests-771684542 None] Deleted volume successfully. Jul 03 01:20:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-77266c6c-9569-4564-9266-29914f6ba3ef tempest-SnapshotDependencyTests-771684542 None] Lock "cinder-7e924448-0cc0-4abe-9a65-0f371698c429-delete_volume" released by "delete_volume" :: held 2.637s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:47 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:20:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Flow 'volume_create_manager' (4425e90c-df8e-474e-aa38-65c7ef6d82b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5909ceeb-42d9-41eb-a3e0-4ec350cc7f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5909ceeb-42d9-41eb-a3e0-4ec350cc7f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-790027212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e348329d-63e4-449f-8b5b-2998cf854cb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e74af4757147bfa3aa3c8cd99476a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:48Z,use_quota=True,user_id='d5783b4466f840d69be29cad4f907538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d52993a6-df73-44ff-97ae-6cec43908e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d52993a6-df73-44ff-97ae-6cec43908e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c68b282-7603-498f-951a-abe6bfafbd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c68b282-7603-498f-951a-abe6bfafbd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e348329d-63e4-449f-8b5b-2998cf854cb4', 'volume_name': 'volume-e348329d-63e4-449f-8b5b-2998cf854cb4', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ced53a-1271-4fda-ac13-7d9f33d176f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ced53a-1271-4fda-ac13-7d9f33d176f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0248da9-0154-4260-ba00-ebf53c42dc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:47 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Volume e348329d-63e4-449f-8b5b-2998cf854cb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e348329d-63e4-449f-8b5b-2998cf854cb4', 'volume_size': 1} Jul 03 01:20:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-790027212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e348329d-63e4-449f-8b5b-2998cf854cb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e74af4757147bfa3aa3c8cd99476a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:48Z,use_quota=True,user_id='d5783b4466f840d69be29cad4f907538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:20:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Creating volume e348329d-63e4-449f-8b5b-2998cf854cb4 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:20:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:20:47 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:20:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e348329d-63e4-449f-8b5b-2998cf854cb4 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:47 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e348329d-63e4-449f-8b5b-2998cf854cb4 1073741824 Jul 03 01:20:47 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:48 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e348329d-63e4-449f-8b5b-2998cf854cb4 1073741824" returned: 0 in 1.050s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e348329d-63e4-449f-8b5b-2998cf854cb4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:48 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e348329d-63e4-449f-8b5b-2998cf854cb4 Jul 03 01:20:48 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:49 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e348329d-63e4-449f-8b5b-2998cf854cb4" returned: 0 in 0.758s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:20:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0248da9-0154-4260-ba00-ebf53c42dc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e348329d-63e4-449f-8b5b-2998cf854cb4', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e882cd48-11bd-4d94-b76a-6cbfc84c5058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:49 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Volume volume-e348329d-63e4-449f-8b5b-2998cf854cb4 (e348329d-63e4-449f-8b5b-2998cf854cb4): created successfully Jul 03 01:20:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e882cd48-11bd-4d94-b76a-6cbfc84c5058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Flow 'volume_create_manager' (4425e90c-df8e-474e-aa38-65c7ef6d82b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:49 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c3aade5f-9112-42e7-ba20-fc01ead9ef51 tempest-VolumesTransfersV355Test-1945002390 None] Created volume successfully. Jul 03 01:20:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5d709d23-38d2-40aa-a244-252f76a70740 tempest-TestStampPattern-1880660764 None] Acquiring lock "cinder-5e746818-315d-4866-a072-0b298f025bca-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5d709d23-38d2-40aa-a244-252f76a70740 tempest-TestStampPattern-1880660764 None] Lock "cinder-5e746818-315d-4866-a072-0b298f025bca-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5d709d23-38d2-40aa-a244-252f76a70740 tempest-TestStampPattern-1880660764 None] Acquiring lock "cinder-quobyte-5e746818-315d-4866-a072-0b298f025bca" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5d709d23-38d2-40aa-a244-252f76a70740 tempest-TestStampPattern-1880660764 None] Lock "cinder-quobyte-5e746818-315d-4866-a072-0b298f025bca" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:51 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f7b147-5460-4d6c-a9b4-5b2135ed5030]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d709d23-38d2-40aa-a244-252f76a70740 tempest-TestStampPattern-1880660764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e746818-315d-4866-a072-0b298f025bca {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:51 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-60a2b9c0-1963-4b5b-9405-1698c2af386a tempest-VolumesTransfersV355Test-970531805 None] Transfer volume completed successfully. Jul 03 01:20:51 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e746818-315d-4866-a072-0b298f025bca Jul 03 01:20:51 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:52 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d709d23-38d2-40aa-a244-252f76a70740 tempest-TestStampPattern-1880660764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e746818-315d-4866-a072-0b298f025bca" returned: 0 in 0.898s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d709d23-38d2-40aa-a244-252f76a70740 tempest-TestStampPattern-1880660764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e746818-315d-4866-a072-0b298f025bca {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:52 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e746818-315d-4866-a072-0b298f025bca Jul 03 01:20:52 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9367241e-53b5-4183-bea5-5694cdf9b7da tempest-VolumesTransfersV355Test-997127172 None] Acquiring lock "cinder-e348329d-63e4-449f-8b5b-2998cf854cb4-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9367241e-53b5-4183-bea5-5694cdf9b7da tempest-VolumesTransfersV355Test-997127172 None] Lock "cinder-e348329d-63e4-449f-8b5b-2998cf854cb4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9367241e-53b5-4183-bea5-5694cdf9b7da tempest-VolumesTransfersV355Test-997127172 None] Acquiring lock "cinder-quobyte-e348329d-63e4-449f-8b5b-2998cf854cb4" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9367241e-53b5-4183-bea5-5694cdf9b7da tempest-VolumesTransfersV355Test-997127172 None] Lock "cinder-quobyte-e348329d-63e4-449f-8b5b-2998cf854cb4" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:52 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[658cf58b-cd05-4b0b-a6d3-152976ecd45f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9367241e-53b5-4183-bea5-5694cdf9b7da tempest-VolumesTransfersV355Test-997127172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e348329d-63e4-449f-8b5b-2998cf854cb4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:53 devstack sudo[104248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e348329d-63e4-449f-8b5b-2998cf854cb4 Jul 03 01:20:53 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:53 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d709d23-38d2-40aa-a244-252f76a70740 tempest-TestStampPattern-1880660764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e746818-315d-4866-a072-0b298f025bca" returned: 0 in 0.815s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5d709d23-38d2-40aa-a244-252f76a70740 tempest-TestStampPattern-1880660764 None] Lock "cinder-quobyte-5e746818-315d-4866-a072-0b298f025bca" released by "delete_volume" :: held 1.799s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:53 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-5d709d23-38d2-40aa-a244-252f76a70740 tempest-TestStampPattern-1880660764 None] Created reservations ['11ddc73f-acc3-4d72-8b42-1d457ff473e7', '8fc2ea86-3915-4c83-beb9-03fef2f41bdb', '1e60784a-e9b0-4282-9087-e38e0854d17a', 'f58633ba-7b8a-45a1-964d-629576b601fc'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:20:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5d709d23-38d2-40aa-a244-252f76a70740 tempest-TestStampPattern-1880660764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5d709d23-38d2-40aa-a244-252f76a70740 tempest-TestStampPattern-1880660764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5d709d23-38d2-40aa-a244-252f76a70740 tempest-TestStampPattern-1880660764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5d709d23-38d2-40aa-a244-252f76a70740 tempest-TestStampPattern-1880660764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5d709d23-38d2-40aa-a244-252f76a70740 tempest-TestStampPattern-1880660764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d709d23-38d2-40aa-a244-252f76a70740 tempest-TestStampPattern-1880660764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:53 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:20:53 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ce0ad891-4204-448a-82e4-bef0a956bece tempest-TestStampPattern-1880660764 None] Acquiring lock "cinder-f4837ae5-964f-44b1-9d8b-e2c659713db8-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ce0ad891-4204-448a-82e4-bef0a956bece tempest-TestStampPattern-1880660764 None] Lock "cinder-f4837ae5-964f-44b1-9d8b-e2c659713db8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ce0ad891-4204-448a-82e4-bef0a956bece tempest-TestStampPattern-1880660764 None] Acquiring lock "cinder-quobyte-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ce0ad891-4204-448a-82e4-bef0a956bece tempest-TestStampPattern-1880660764 None] Lock "cinder-quobyte-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ce0ad891-4204-448a-82e4-bef0a956bece tempest-TestStampPattern-1880660764 None] Acquiring lock "cinder-quobyte-f4837ae5-964f-44b1-9d8b-e2c659713db8" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ce0ad891-4204-448a-82e4-bef0a956bece tempest-TestStampPattern-1880660764 None] Lock "cinder-quobyte-f4837ae5-964f-44b1-9d8b-e2c659713db8" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-ce0ad891-4204-448a-82e4-bef0a956bece tempest-TestStampPattern-1880660764 None] Deleting offline snapshot f4837ae5-964f-44b1-9d8b-e2c659713db8 of volume f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:20:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-ce0ad891-4204-448a-82e4-bef0a956bece tempest-TestStampPattern-1880660764 None] snapshot_file for this snap is: volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.f4837ae5-964f-44b1-9d8b-e2c659713db8 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:20:54 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2680cff6-55e8-4a54-8972-94028f6a7ca3]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ce0ad891-4204-448a-82e4-bef0a956bece tempest-TestStampPattern-1880660764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.f4837ae5-964f-44b1-9d8b-e2c659713db8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:54 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9367241e-53b5-4183-bea5-5694cdf9b7da tempest-VolumesTransfersV355Test-997127172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e348329d-63e4-449f-8b5b-2998cf854cb4" returned: 0 in 1.189s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9367241e-53b5-4183-bea5-5694cdf9b7da tempest-VolumesTransfersV355Test-997127172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e348329d-63e4-449f-8b5b-2998cf854cb4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:54 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5d709d23-38d2-40aa-a244-252f76a70740 tempest-TestStampPattern-1880660764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.816s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:54 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-5d709d23-38d2-40aa-a244-252f76a70740 tempest-TestStampPattern-1880660764 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:20:54 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e348329d-63e4-449f-8b5b-2998cf854cb4 Jul 03 01:20:54 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5d709d23-38d2-40aa-a244-252f76a70740 tempest-TestStampPattern-1880660764 None] Deleted volume successfully. Jul 03 01:20:54 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5d709d23-38d2-40aa-a244-252f76a70740 tempest-TestStampPattern-1880660764 None] Lock "cinder-5e746818-315d-4866-a072-0b298f025bca-delete_volume" released by "delete_volume" :: held 2.931s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:54 devstack sudo[104257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.f4837ae5-964f-44b1-9d8b-e2c659713db8 Jul 03 01:20:54 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:54 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9367241e-53b5-4183-bea5-5694cdf9b7da tempest-VolumesTransfersV355Test-997127172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e348329d-63e4-449f-8b5b-2998cf854cb4" returned: 0 in 0.794s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9367241e-53b5-4183-bea5-5694cdf9b7da tempest-VolumesTransfersV355Test-997127172 None] Lock "cinder-quobyte-e348329d-63e4-449f-8b5b-2998cf854cb4" released by "delete_volume" :: held 2.022s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:54 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ce0ad891-4204-448a-82e4-bef0a956bece tempest-TestStampPattern-1880660764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.f4837ae5-964f-44b1-9d8b-e2c659713db8" returned: 0 in 0.888s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-ce0ad891-4204-448a-82e4-bef0a956bece tempest-TestStampPattern-1880660764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:20:54 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c65f34-bcbd-4100-9885-a9c62d488868]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ce0ad891-4204-448a-82e4-bef0a956bece tempest-TestStampPattern-1880660764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:54 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-9367241e-53b5-4183-bea5-5694cdf9b7da tempest-VolumesTransfersV355Test-997127172 None] Created reservations ['fc55241b-582f-4c22-b97d-c96b1fdd8edf', '5f86a626-e649-4ab9-a030-3e8df2113a67', '657c2f74-f8d7-4acb-bae3-f09cf5c8541a', '73f8fc33-3b79-4d1d-a633-2fb0a76a2112'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:20:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9367241e-53b5-4183-bea5-5694cdf9b7da tempest-VolumesTransfersV355Test-997127172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9367241e-53b5-4183-bea5-5694cdf9b7da tempest-VolumesTransfersV355Test-997127172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9367241e-53b5-4183-bea5-5694cdf9b7da tempest-VolumesTransfersV355Test-997127172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:55 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 Jul 03 01:20:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9367241e-53b5-4183-bea5-5694cdf9b7da tempest-VolumesTransfersV355Test-997127172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9367241e-53b5-4183-bea5-5694cdf9b7da tempest-VolumesTransfersV355Test-997127172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9367241e-53b5-4183-bea5-5694cdf9b7da tempest-VolumesTransfersV355Test-997127172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:55 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:55 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:20:55 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:55 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ce0ad891-4204-448a-82e4-bef0a956bece tempest-TestStampPattern-1880660764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017" returned: 0 in 0.786s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ce0ad891-4204-448a-82e4-bef0a956bece tempest-TestStampPattern-1880660764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.f4837ae5-964f-44b1-9d8b-e2c659713db8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:55 devstack sudo[104273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.f4837ae5-964f-44b1-9d8b-e2c659713db8 Jul 03 01:20:55 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:55 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9367241e-53b5-4183-bea5-5694cdf9b7da tempest-VolumesTransfersV355Test-997127172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.719s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:55 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-9367241e-53b5-4183-bea5-5694cdf9b7da tempest-VolumesTransfersV355Test-997127172 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:20:55 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9367241e-53b5-4183-bea5-5694cdf9b7da tempest-VolumesTransfersV355Test-997127172 None] Deleted volume successfully. Jul 03 01:20:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-9367241e-53b5-4183-bea5-5694cdf9b7da tempest-VolumesTransfersV355Test-997127172 None] Lock "cinder-e348329d-63e4-449f-8b5b-2998cf854cb4-delete_volume" released by "delete_volume" :: held 3.013s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:56 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ce0ad891-4204-448a-82e4-bef0a956bece tempest-TestStampPattern-1880660764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.f4837ae5-964f-44b1-9d8b-e2c659713db8" returned: 0 in 0.842s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ce0ad891-4204-448a-82e4-bef0a956bece tempest-TestStampPattern-1880660764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.f4837ae5-964f-44b1-9d8b-e2c659713db8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:56 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.f4837ae5-964f-44b1-9d8b-e2c659713db8 Jul 03 01:20:56 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:56 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:20:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Flow 'volume_create_manager' (f6e6c515-67da-4395-a9f1-bbdbc623d809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a0c4b0e-10f3-4482-a04d-1d53280ddcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a0c4b0e-10f3-4482-a04d-1d53280ddcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1517669495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e74af4757147bfa3aa3c8cd99476a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:57Z,use_quota=True,user_id='d5783b4466f840d69be29cad4f907538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (457d5a15-7c05-4eda-9bf5-19ac6407209e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (457d5a15-7c05-4eda-9bf5-19ac6407209e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d65e7b6-8b15-46bb-868d-51ea9a84e1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d65e7b6-8b15-46bb-868d-51ea9a84e1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8', 'volume_name': 'volume-cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f51cd454-c643-4d18-b30c-ab15fd8787b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f51cd454-c643-4d18-b30c-ab15fd8787b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb81d231-9711-4d2a-aa4d-f31fe1dc63a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:56 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Volume cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8', 'volume_size': 1} Jul 03 01:20:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1517669495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e74af4757147bfa3aa3c8cd99476a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:20:57Z,use_quota=True,user_id='d5783b4466f840d69be29cad4f907538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:20:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Creating volume cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:20:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:20:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:20:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:20:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:20:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:20:56 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:20:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:56 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8 1073741824 Jul 03 01:20:56 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:57 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ce0ad891-4204-448a-82e4-bef0a956bece tempest-TestStampPattern-1880660764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017.f4837ae5-964f-44b1-9d8b-e2c659713db8" returned: 0 in 0.720s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ce0ad891-4204-448a-82e4-bef0a956bece tempest-TestStampPattern-1880660764 None] Lock "cinder-quobyte-f4837ae5-964f-44b1-9d8b-e2c659713db8" released by "_delete_snapshot" :: held 3.371s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ce0ad891-4204-448a-82e4-bef0a956bece tempest-TestStampPattern-1880660764 None] Lock "cinder-quobyte-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017" released by "delete_snapshot" :: held 3.415s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:57 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-ce0ad891-4204-448a-82e4-bef0a956bece tempest-TestStampPattern-1880660764 None] Created reservations ['5a116e9a-490c-49f2-b42b-169e6b480b32', 'f2dc4b0f-1e8c-431d-982b-16db364d5a79', 'e120bfd2-4e2b-4649-8ad3-1f21a66f7905', 'f3a9f780-861d-4e59-ac27-e2b86ae38c28'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:20:57 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ce0ad891-4204-448a-82e4-bef0a956bece tempest-TestStampPattern-1880660764 None] Delete snapshot completed successfully. Jul 03 01:20:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ce0ad891-4204-448a-82e4-bef0a956bece tempest-TestStampPattern-1880660764 None] Lock "cinder-f4837ae5-964f-44b1-9d8b-e2c659713db8-delete_snapshot" released by "delete_snapshot" :: held 3.606s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:20:57 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8 1073741824" returned: 0 in 0.929s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:57 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8 Jul 03 01:20:57 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:20:58 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Jul 03 01:20:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8" returned: 0 in 0.677s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:20:58 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:20:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:20:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb81d231-9711-4d2a-aa4d-f31fe1dc63a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a89bbb4-3356-469e-849f-c4a15426c75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:20:58 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Volume volume-cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8 (cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8): created successfully Jul 03 01:20:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a89bbb4-3356-469e-849f-c4a15426c75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:20:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Flow 'volume_create_manager' (f6e6c515-67da-4395-a9f1-bbdbc623d809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:20:58 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b4ed0074-afd4-447c-8cb9-6a0b5792b175 tempest-VolumesTransfersV355Test-1945002390 None] Created volume successfully. Jul 03 01:20:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-efa101d4-95bb-4b1b-8e02-a2c535700317 tempest-VolumesTransfersV355Test-997127172 None] Acquiring lock "cinder-cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-efa101d4-95bb-4b1b-8e02-a2c535700317 tempest-VolumesTransfersV355Test-997127172 None] Lock "cinder-cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-efa101d4-95bb-4b1b-8e02-a2c535700317 tempest-VolumesTransfersV355Test-997127172 None] Acquiring lock "cinder-quobyte-cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:20:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-efa101d4-95bb-4b1b-8e02-a2c535700317 tempest-VolumesTransfersV355Test-997127172 None] Lock "cinder-quobyte-cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:20:59 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[733892bd-455a-4b61-8302-4df63b7b835f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:20:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-efa101d4-95bb-4b1b-8e02-a2c535700317 tempest-VolumesTransfersV355Test-997127172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:20:59 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8 Jul 03 01:20:59 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:00 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-efa101d4-95bb-4b1b-8e02-a2c535700317 tempest-VolumesTransfersV355Test-997127172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8" returned: 0 in 0.888s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-efa101d4-95bb-4b1b-8e02-a2c535700317 tempest-VolumesTransfersV355Test-997127172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:00 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8 Jul 03 01:21:00 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:00 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-efa101d4-95bb-4b1b-8e02-a2c535700317 tempest-VolumesTransfersV355Test-997127172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8" returned: 0 in 0.873s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-efa101d4-95bb-4b1b-8e02-a2c535700317 tempest-VolumesTransfersV355Test-997127172 None] Lock "cinder-quobyte-cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8" released by "delete_volume" :: held 1.807s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:01 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-efa101d4-95bb-4b1b-8e02-a2c535700317 tempest-VolumesTransfersV355Test-997127172 None] Created reservations ['e5cd06fe-ab89-4599-8836-7df1810914c0', 'b36926dd-1abd-4ddc-a3dc-17c6d5059380', '2dfdaf0e-126f-4812-a517-26ddfc8fac6e', 'd21e816a-d56c-4bce-bd5e-b62ddde93642'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:21:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-efa101d4-95bb-4b1b-8e02-a2c535700317 tempest-VolumesTransfersV355Test-997127172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-efa101d4-95bb-4b1b-8e02-a2c535700317 tempest-VolumesTransfersV355Test-997127172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-efa101d4-95bb-4b1b-8e02-a2c535700317 tempest-VolumesTransfersV355Test-997127172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:21:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-efa101d4-95bb-4b1b-8e02-a2c535700317 tempest-VolumesTransfersV355Test-997127172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:21:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-efa101d4-95bb-4b1b-8e02-a2c535700317 tempest-VolumesTransfersV355Test-997127172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-efa101d4-95bb-4b1b-8e02-a2c535700317 tempest-VolumesTransfersV355Test-997127172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:01 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:21:01 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:01 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-efa101d4-95bb-4b1b-8e02-a2c535700317 tempest-VolumesTransfersV355Test-997127172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.730s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:01 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-efa101d4-95bb-4b1b-8e02-a2c535700317 tempest-VolumesTransfersV355Test-997127172 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:21:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-efa101d4-95bb-4b1b-8e02-a2c535700317 tempest-VolumesTransfersV355Test-997127172 None] Deleted volume successfully. Jul 03 01:21:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-efa101d4-95bb-4b1b-8e02-a2c535700317 tempest-VolumesTransfersV355Test-997127172 None] Lock "cinder-cad6b97a-7d1f-45e5-a5f1-c4fd9b32aca8-delete_volume" released by "delete_volume" :: held 2.790s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a09861bc-27d7-45b0-9ce7-fd3fede2850f tempest-TestStampPattern-1880660764 None] Acquiring lock "cinder-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a09861bc-27d7-45b0-9ce7-fd3fede2850f tempest-TestStampPattern-1880660764 None] Lock "cinder-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a09861bc-27d7-45b0-9ce7-fd3fede2850f tempest-TestStampPattern-1880660764 None] Acquiring lock "cinder-quobyte-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a09861bc-27d7-45b0-9ce7-fd3fede2850f tempest-TestStampPattern-1880660764 None] Lock "cinder-quobyte-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017" acquired by "delete_volume" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:05 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede1a899-3f8b-4948-8ce2-4f2d40dbbc8b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a09861bc-27d7-45b0-9ce7-fd3fede2850f tempest-TestStampPattern-1880660764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:05 devstack sudo[104349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 Jul 03 01:21:05 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:06 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a09861bc-27d7-45b0-9ce7-fd3fede2850f tempest-TestStampPattern-1880660764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017" returned: 0 in 0.798s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a09861bc-27d7-45b0-9ce7-fd3fede2850f tempest-TestStampPattern-1880660764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:06 devstack sudo[104354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017 Jul 03 01:21:06 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:07 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a09861bc-27d7-45b0-9ce7-fd3fede2850f tempest-TestStampPattern-1880660764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017" returned: 0 in 0.711s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a09861bc-27d7-45b0-9ce7-fd3fede2850f tempest-TestStampPattern-1880660764 None] Lock "cinder-quobyte-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017" released by "delete_volume" :: held 1.580s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:07 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-a09861bc-27d7-45b0-9ce7-fd3fede2850f tempest-TestStampPattern-1880660764 None] Created reservations ['40f1bf15-5075-45aa-b769-8dc5c9a070ef', '0502e028-386f-48e7-9bef-23aaaae3d94f', '15abb146-ea42-4d92-a2fd-be261b84ab81', 'caf2508d-532a-46bf-b9cc-a4bae195d2b9'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:21:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a09861bc-27d7-45b0-9ce7-fd3fede2850f tempest-TestStampPattern-1880660764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a09861bc-27d7-45b0-9ce7-fd3fede2850f tempest-TestStampPattern-1880660764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a09861bc-27d7-45b0-9ce7-fd3fede2850f tempest-TestStampPattern-1880660764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:21:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a09861bc-27d7-45b0-9ce7-fd3fede2850f tempest-TestStampPattern-1880660764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:21:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a09861bc-27d7-45b0-9ce7-fd3fede2850f tempest-TestStampPattern-1880660764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a09861bc-27d7-45b0-9ce7-fd3fede2850f tempest-TestStampPattern-1880660764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:07 devstack sudo[104357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:21:07 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a09861bc-27d7-45b0-9ce7-fd3fede2850f tempest-TestStampPattern-1880660764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.728s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:08 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-a09861bc-27d7-45b0-9ce7-fd3fede2850f tempest-TestStampPattern-1880660764 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:21:08 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:08 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a09861bc-27d7-45b0-9ce7-fd3fede2850f tempest-TestStampPattern-1880660764 None] Deleted volume successfully. Jul 03 01:21:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a09861bc-27d7-45b0-9ce7-fd3fede2850f tempest-TestStampPattern-1880660764 None] Lock "cinder-f43b4c42-c5bf-4c5c-99b9-ecb8519ae017-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:21:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:21:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:21:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:12 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:21:12 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:13 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.866s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:21:13 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:21:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 29 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:21:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:21:16 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:21:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Flow 'volume_create_manager' (8931b76d-1bd1-4ea5-9e28-ea87068d04bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:21:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf20e547-8c99-4ae7-adee-4262e4cc9904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:16 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=103,cinder:SELECT=85,cinder:INSERT=25,cinder:DELETE=5 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:21:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf20e547-8c99-4ae7-adee-4262e4cc9904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-57397090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5747c227-a22e-4723-a7dd-386db9cf8336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d26f56b8034d6d962d96784784199e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:21:17Z,use_quota=True,user_id='3ca48520154f47179f254f3272ab50e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91929322-2658-4d48-83c7-0c73fc5f5471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91929322-2658-4d48-83c7-0c73fc5f5471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (063da2b9-4bcd-4231-9582-5d301d8f2753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (063da2b9-4bcd-4231-9582-5d301d8f2753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5747c227-a22e-4723-a7dd-386db9cf8336', 'volume_name': 'volume-5747c227-a22e-4723-a7dd-386db9cf8336', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b0e1ff2-1a57-4307-8d2a-862e3987c0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b0e1ff2-1a57-4307-8d2a-862e3987c0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c37e2b3-512a-484f-89eb-cac64659fe70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:16 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Volume 5747c227-a22e-4723-a7dd-386db9cf8336: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5747c227-a22e-4723-a7dd-386db9cf8336', 'volume_size': 1} Jul 03 01:21:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-57397090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5747c227-a22e-4723-a7dd-386db9cf8336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d26f56b8034d6d962d96784784199e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:21:17Z,use_quota=True,user_id='3ca48520154f47179f254f3272ab50e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:21:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Creating volume 5747c227-a22e-4723-a7dd-386db9cf8336 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:21:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:21:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:21:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:21:16 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:21:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:16 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336 1073741824 Jul 03 01:21:16 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:17 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336 1073741824" returned: 0 in 1.041s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:17 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336 Jul 03 01:21:18 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:18 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336" returned: 0 in 0.697s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:21:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:18 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=78,cinder:UPDATE=108,cinder:DELETE=10,cinder:INSERT=29 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:21:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c37e2b3-512a-484f-89eb-cac64659fe70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5747c227-a22e-4723-a7dd-386db9cf8336', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf45e065-e03f-4ccb-adcd-bfbd3f43017c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:18 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Volume volume-5747c227-a22e-4723-a7dd-386db9cf8336 (5747c227-a22e-4723-a7dd-386db9cf8336): created successfully Jul 03 01:21:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf45e065-e03f-4ccb-adcd-bfbd3f43017c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Flow 'volume_create_manager' (8931b76d-1bd1-4ea5-9e28-ea87068d04bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:21:18 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a5c6c0e6-5128-4249-9ab9-8c57db7308f3 tempest-VolumesSnapshotTestJSON-1487329281 None] Created volume successfully. Jul 03 01:21:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-aa533b9a-6166-4d8a-881f-fd70a10392da tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-aa533b9a-6166-4d8a-881f-fd70a10392da tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-aa533b9a-6166-4d8a-881f-fd70a10392da tempest-VolumesSnapshotTestJSON-1487329281 None] Creating offline snapshot a96dd236-1a8d-4d41-8469-61d1ef618b1c of volume 5747c227-a22e-4723-a7dd-386db9cf8336 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:21:19 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb89b337-3f6e-475e-9aa2-835a790fa782]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-aa533b9a-6166-4d8a-881f-fd70a10392da tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:19 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336 Jul 03 01:21:19 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:20 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-aa533b9a-6166-4d8a-881f-fd70a10392da tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336" returned: 0 in 0.904s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-aa533b9a-6166-4d8a-881f-fd70a10392da tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336.a96dd236-1a8d-4d41-8469-61d1ef618b1c 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:20 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336.a96dd236-1a8d-4d41-8469-61d1ef618b1c 1G Jul 03 01:21:20 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:21 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-aa533b9a-6166-4d8a-881f-fd70a10392da tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336.a96dd236-1a8d-4d41-8469-61d1ef618b1c 1G" returned: 0 in 0.906s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-aa533b9a-6166-4d8a-881f-fd70a10392da tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5747c227-a22e-4723-a7dd-386db9cf8336 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336.a96dd236-1a8d-4d41-8469-61d1ef618b1c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:21 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5747c227-a22e-4723-a7dd-386db9cf8336 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336.a96dd236-1a8d-4d41-8469-61d1ef618b1c Jul 03 01:21:21 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:21 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-aa533b9a-6166-4d8a-881f-fd70a10392da tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5747c227-a22e-4723-a7dd-386db9cf8336 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336.a96dd236-1a8d-4d41-8469-61d1ef618b1c" returned: 0 in 0.812s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:21 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-aa533b9a-6166-4d8a-881f-fd70a10392da tempest-VolumesSnapshotTestJSON-1487329281 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336.a96dd236-1a8d-4d41-8469-61d1ef618b1c is being set with open permissions: ugo+rw Jul 03 01:21:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-aa533b9a-6166-4d8a-881f-fd70a10392da tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336.a96dd236-1a8d-4d41-8469-61d1ef618b1c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:21 devstack sudo[104435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336.a96dd236-1a8d-4d41-8469-61d1ef618b1c Jul 03 01:21:21 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:22 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-aa533b9a-6166-4d8a-881f-fd70a10392da tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336.a96dd236-1a8d-4d41-8469-61d1ef618b1c" returned: 0 in 0.654s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-aa533b9a-6166-4d8a-881f-fd70a10392da tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:22 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336.info Jul 03 01:21:22 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:23 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-aa533b9a-6166-4d8a-881f-fd70a10392da tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336.info" returned: 0 in 0.703s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:23 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-aa533b9a-6166-4d8a-881f-fd70a10392da tempest-VolumesSnapshotTestJSON-1487329281 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336.info is being set with open permissions: ugo+rw Jul 03 01:21:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-aa533b9a-6166-4d8a-881f-fd70a10392da tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:23 devstack sudo[104441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336.info Jul 03 01:21:23 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:24 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-aa533b9a-6166-4d8a-881f-fd70a10392da tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336.info" returned: 0 in 0.741s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-aa533b9a-6166-4d8a-881f-fd70a10392da tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.826s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:24 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-aa533b9a-6166-4d8a-881f-fd70a10392da tempest-VolumesSnapshotTestJSON-1487329281 None] Create snapshot completed successfully Jul 03 01:21:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0ac9d23f-e9f7-4aae-b552-fb26638e240b tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "cinder-a96dd236-1a8d-4d41-8469-61d1ef618b1c-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0ac9d23f-e9f7-4aae-b552-fb26638e240b tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-a96dd236-1a8d-4d41-8469-61d1ef618b1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0ac9d23f-e9f7-4aae-b552-fb26638e240b tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "cinder-quobyte-5747c227-a22e-4723-a7dd-386db9cf8336" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0ac9d23f-e9f7-4aae-b552-fb26638e240b tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-5747c227-a22e-4723-a7dd-386db9cf8336" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0ac9d23f-e9f7-4aae-b552-fb26638e240b tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "cinder-quobyte-a96dd236-1a8d-4d41-8469-61d1ef618b1c" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0ac9d23f-e9f7-4aae-b552-fb26638e240b tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-a96dd236-1a8d-4d41-8469-61d1ef618b1c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-0ac9d23f-e9f7-4aae-b552-fb26638e240b tempest-VolumesSnapshotTestJSON-1487329281 None] Deleting offline snapshot a96dd236-1a8d-4d41-8469-61d1ef618b1c of volume 5747c227-a22e-4723-a7dd-386db9cf8336 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:21:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-0ac9d23f-e9f7-4aae-b552-fb26638e240b tempest-VolumesSnapshotTestJSON-1487329281 None] snapshot_file for this snap is: volume-5747c227-a22e-4723-a7dd-386db9cf8336.a96dd236-1a8d-4d41-8469-61d1ef618b1c {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:21:24 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[75503e59-f96c-41fd-bec2-0674df612ae4]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0ac9d23f-e9f7-4aae-b552-fb26638e240b tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336.a96dd236-1a8d-4d41-8469-61d1ef618b1c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:24 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336.a96dd236-1a8d-4d41-8469-61d1ef618b1c Jul 03 01:21:24 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:25 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0ac9d23f-e9f7-4aae-b552-fb26638e240b tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336.a96dd236-1a8d-4d41-8469-61d1ef618b1c" returned: 0 in 0.874s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-0ac9d23f-e9f7-4aae-b552-fb26638e240b tempest-VolumesSnapshotTestJSON-1487329281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5747c227-a22e-4723-a7dd-386db9cf8336(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:21:25 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3667cde5-2f87-42f7-9ad5-f5f6f3d663a4]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0ac9d23f-e9f7-4aae-b552-fb26638e240b tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:25 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336 Jul 03 01:21:25 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:26 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0ac9d23f-e9f7-4aae-b552-fb26638e240b tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336" returned: 0 in 0.810s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0ac9d23f-e9f7-4aae-b552-fb26638e240b tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336.a96dd236-1a8d-4d41-8469-61d1ef618b1c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:26 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336.a96dd236-1a8d-4d41-8469-61d1ef618b1c Jul 03 01:21:26 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:27 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:21:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Flow 'volume_create_manager' (3cd87325-46fa-4108-a527-b4387b04388b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:21:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79fda5bd-29ca-4ef9-a5b0-fe4d82c0cc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79fda5bd-29ca-4ef9-a5b0-fe4d82c0cc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6edfe8-fcee-4059-8e9c-244121c510ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f1d31f346a9410288b4c6523d5fbdb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:21:27Z,use_quota=True,user_id='ef5f5fc2c8a74c448951bfdfbce90e99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1170c40-a58d-448d-bf46-d806a8f46149),volume_type_id=d1170c40-a58d-448d-bf46-d806a8f46149)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a003cf1-f5c4-4acb-b37d-e0006a259cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a003cf1-f5c4-4acb-b37d-e0006a259cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e72e1e3-312f-4e7e-b5fc-1a990e1827a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:27 devstack cinder-volume[86772]: DEBUG cinder.image.glance [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Creating Keystone auth plugin from conf {{(pid=86772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 01:21:27 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0ac9d23f-e9f7-4aae-b552-fb26638e240b tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336.a96dd236-1a8d-4d41-8469-61d1ef618b1c" returned: 0 in 0.799s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0ac9d23f-e9f7-4aae-b552-fb26638e240b tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336.a96dd236-1a8d-4d41-8469-61d1ef618b1c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:27 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336.a96dd236-1a8d-4d41-8469-61d1ef618b1c Jul 03 01:21:27 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e72e1e3-312f-4e7e-b5fc-1a990e1827a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'de6edfe8-fcee-4059-8e9c-244121c510ce', 'volume_name': 'volume-de6edfe8-fcee-4059-8e9c-244121c510ce', 'volume_size': 1, 'image_id': '0a971c02-ac90-4517-b93c-8f160739af57', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a971c02-ac90-4517-b93c-8f160739af57', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e81dc555376b8128311e8cb476cd284', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6f1d31f346a9410288b4c6523d5fbdb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c6f2aabc85fd7b73f98625424b93ca9e114c0d041fa19faa0e6a572c01520e7e41d2bf2b189d97d666ac9d507166df84d7ad1b54a7f697f9c27875417f993dd5', 'id': '0a971c02-ac90-4517-b93c-8f160739af57', 'created_at': datetime.datetime(2026, 7, 2, 23, 21, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 21, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a971c02-ac90-4517-b93c-8f160739af57/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4b5461e-9d35-4ca2-b4d4-015010c3a808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4b5461e-9d35-4ca2-b4d4-015010c3a808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a6038e-ae12-4414-8e4a-72574b5ebea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:27 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Volume de6edfe8-fcee-4059-8e9c-244121c510ce: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-de6edfe8-fcee-4059-8e9c-244121c510ce', 'volume_size': 1, 'image_id': '0a971c02-ac90-4517-b93c-8f160739af57', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a971c02-ac90-4517-b93c-8f160739af57', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e81dc555376b8128311e8cb476cd284', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6f1d31f346a9410288b4c6523d5fbdb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c6f2aabc85fd7b73f98625424b93ca9e114c0d041fa19faa0e6a572c01520e7e41d2bf2b189d97d666ac9d507166df84d7ad1b54a7f697f9c27875417f993dd5', 'id': '0a971c02-ac90-4517-b93c-8f160739af57', 'created_at': datetime.datetime(2026, 7, 2, 23, 21, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 21, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a971c02-ac90-4517-b93c-8f160739af57/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 03 01:21:27 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Trying to clone de6edfe8-fcee-4059-8e9c-244121c510ce from image 0a971c02-ac90-4517-b93c-8f160739af57 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0a971c02-ac90-4517-b93c-8f160739af57', 'metadata': {}}]). {{(pid=86772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 01:21:27 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0a971c02-ac90-4517-b93c-8f160739af57_8kvck3mwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 01:21:27 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Image download 0.00 MB at 0.00 MB/s Jul 03 01:21:27 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[683f9df4-e0f8-4ded-bdf4-bf3d82307158]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a971c02-ac90-4517-b93c-8f160739af57_8kvck3mwdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:27 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a971c02-ac90-4517-b93c-8f160739af57_8kvck3mwdevstack@QuobyteHD Jul 03 01:21:27 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:27 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0ac9d23f-e9f7-4aae-b552-fb26638e240b tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336.a96dd236-1a8d-4d41-8469-61d1ef618b1c" returned: 0 in 0.675s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0ac9d23f-e9f7-4aae-b552-fb26638e240b tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-a96dd236-1a8d-4d41-8469-61d1ef618b1c" released by "_delete_snapshot" :: held 3.275s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0ac9d23f-e9f7-4aae-b552-fb26638e240b tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-5747c227-a22e-4723-a7dd-386db9cf8336" released by "delete_snapshot" :: held 3.302s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:28 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-0ac9d23f-e9f7-4aae-b552-fb26638e240b tempest-VolumesSnapshotTestJSON-1487329281 None] Created reservations ['9fa02a4e-0332-437d-8e05-8753f44286f0', '570879bc-b4ae-4624-a0c5-89be7862ba90', '6665b8d6-58b9-498d-a272-c807749d106b', 'f6ed1e5c-3351-4fb9-8380-9fc07b52da73'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:21:28 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-0ac9d23f-e9f7-4aae-b552-fb26638e240b tempest-VolumesSnapshotTestJSON-1487329281 None] Delete snapshot completed successfully. Jul 03 01:21:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-0ac9d23f-e9f7-4aae-b552-fb26638e240b tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-a96dd236-1a8d-4d41-8469-61d1ef618b1c-delete_snapshot" released by "delete_snapshot" :: held 3.491s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:28 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a971c02-ac90-4517-b93c-8f160739af57_8kvck3mwdevstack@QuobyteHD" returned: 0 in 0.755s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a971c02-ac90-4517-b93c-8f160739af57_8kvck3mwdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:28 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a971c02-ac90-4517-b93c-8f160739af57_8kvck3mwdevstack@QuobyteHD Jul 03 01:21:28 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:29 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a971c02-ac90-4517-b93c-8f160739af57_8kvck3mwdevstack@QuobyteHD" returned: 1 in 0.746s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a971c02-ac90-4517-b93c-8f160739af57_8kvck3mwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Temporary image 0a971c02-ac90-4517-b93c-8f160739af57 is fetched for user ef5f5fc2c8a74c448951bfdfbce90e99. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b0d402-f2c3-4a60-ace6-2cce0b9cca55]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a971c02-ac90-4517-b93c-8f160739af57_8kvck3mwdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:29 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a971c02-ac90-4517-b93c-8f160739af57_8kvck3mwdevstack@QuobyteHD Jul 03 01:21:29 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Flow 'volume_create_manager' (4ac997b7-9ae1-41b9-8fb8-bd28bf1b49b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f4fc9d-f455-4b96-b201-155825180980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f4fc9d-f455-4b96-b201-155825180980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1532180224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a858c34-a67f-47bd-91bf-b3a170d51480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d26f56b8034d6d962d96784784199e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:21:29Z,use_quota=True,user_id='3ca48520154f47179f254f3272ab50e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (975ac184-aca4-4476-a335-879ab9af41d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (975ac184-aca4-4476-a335-879ab9af41d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76ee1d7-ea31-44c1-a4d7-32d79b68f619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76ee1d7-ea31-44c1-a4d7-32d79b68f619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a858c34-a67f-47bd-91bf-b3a170d51480', 'volume_name': 'volume-4a858c34-a67f-47bd-91bf-b3a170d51480', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0901721a-ea4f-420b-80f8-c8adbbb4ef1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0901721a-ea4f-420b-80f8-c8adbbb4ef1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f878e8d6-8692-4f52-b5a8-62f2b71e3416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:29 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Volume 4a858c34-a67f-47bd-91bf-b3a170d51480: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a858c34-a67f-47bd-91bf-b3a170d51480', 'volume_size': 1} Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1532180224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a858c34-a67f-47bd-91bf-b3a170d51480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d26f56b8034d6d962d96784784199e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:21:29Z,use_quota=True,user_id='3ca48520154f47179f254f3272ab50e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Creating volume 4a858c34-a67f-47bd-91bf-b3a170d51480 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:21:29 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:29 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480 1073741824 Jul 03 01:21:29 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:29 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a971c02-ac90-4517-b93c-8f160739af57_8kvck3mwdevstack@QuobyteHD" returned: 0 in 0.754s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a971c02-ac90-4517-b93c-8f160739af57_8kvck3mwdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:30 devstack sudo[104483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a971c02-ac90-4517-b93c-8f160739af57_8kvck3mwdevstack@QuobyteHD Jul 03 01:21:30 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:30 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480 1073741824" returned: 0 in 0.895s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:30 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480 Jul 03 01:21:30 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:30 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a971c02-ac90-4517-b93c-8f160739af57_8kvck3mwdevstack@QuobyteHD" returned: 1 in 0.777s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a971c02-ac90-4517-b93c-8f160739af57_8kvck3mwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:21:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:31 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480" returned: 0 in 0.620s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:21:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.329s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6edfe8-fcee-4059-8e9c-244121c510ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f1d31f346a9410288b4c6523d5fbdb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:21:27Z,use_quota=True,user_id='ef5f5fc2c8a74c448951bfdfbce90e99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1170c40-a58d-448d-bf46-d806a8f46149),volume_type_id=d1170c40-a58d-448d-bf46-d806a8f46149)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:21:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Creating volume de6edfe8-fcee-4059-8e9c-244121c510ce {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:21:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:21:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:21:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:21:31 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:21:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:31 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce 1073741824 Jul 03 01:21:31 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f878e8d6-8692-4f52-b5a8-62f2b71e3416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a858c34-a67f-47bd-91bf-b3a170d51480', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5d8ff1e-5c12-4966-8830-931efeb7e071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:31 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Volume volume-4a858c34-a67f-47bd-91bf-b3a170d51480 (4a858c34-a67f-47bd-91bf-b3a170d51480): created successfully Jul 03 01:21:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5d8ff1e-5c12-4966-8830-931efeb7e071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Flow 'volume_create_manager' (4ac997b7-9ae1-41b9-8fb8-bd28bf1b49b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:21:31 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-17ae3909-3046-4f52-a787-6909a3c69db5 tempest-VolumesSnapshotTestJSON-1487329281 None] Created volume successfully. Jul 03 01:21:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d8bcc994-2e92-4071-8386-5d4de1bbb659 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:31 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce 1073741824" returned: 0 in 0.845s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:32 devstack sudo[104500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce Jul 03 01:21:32 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:32 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce" returned: 0 in 0.669s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:21:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d8bcc994-2e92-4071-8386-5d4de1bbb659 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.980s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-d8bcc994-2e92-4071-8386-5d4de1bbb659 tempest-VolumesSnapshotTestJSON-1487329281 None] Creating offline snapshot 3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4 of volume 4a858c34-a67f-47bd-91bf-b3a170d51480 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:21:32 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Attempting download of 0a971c02-ac90-4517-b93c-8f160739af57 ((None, [{'url': 'file:///opt/stack/data/glance/images/0a971c02-ac90-4517-b93c-8f160739af57', 'metadata': {}}])) to volume de6edfe8-fcee-4059-8e9c-244121c510ce. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 01:21:32 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ca9347-11f5-45f8-baaa-2ac01522a299]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d8bcc994-2e92-4071-8386-5d4de1bbb659 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:32 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8d2243-5742-488b-84ed-29512280c528]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a971c02-ac90-4517-b93c-8f160739af57_o83mkh7g {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:32 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480 Jul 03 01:21:32 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:32 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a971c02-ac90-4517-b93c-8f160739af57_o83mkh7g Jul 03 01:21:32 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:33 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d8bcc994-2e92-4071-8386-5d4de1bbb659 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480" returned: 0 in 0.795s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d8bcc994-2e92-4071-8386-5d4de1bbb659 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:33 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a971c02-ac90-4517-b93c-8f160739af57_o83mkh7g" returned: 0 in 0.766s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a971c02-ac90-4517-b93c-8f160739af57_o83mkh7g {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:33 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4 1G Jul 03 01:21:33 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:33 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a971c02-ac90-4517-b93c-8f160739af57_o83mkh7g Jul 03 01:21:33 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:34 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a971c02-ac90-4517-b93c-8f160739af57_o83mkh7g" returned: 1 in 0.757s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a971c02-ac90-4517-b93c-8f160739af57_o83mkh7g' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:21:34 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[179fe1a8-7e32-4961-acd6-c7eac8123116]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a971c02-ac90-4517-b93c-8f160739af57_8kvck3mwdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:34 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d8bcc994-2e92-4071-8386-5d4de1bbb659 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4 1G" returned: 0 in 0.862s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d8bcc994-2e92-4071-8386-5d4de1bbb659 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a858c34-a67f-47bd-91bf-b3a170d51480 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:34 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a858c34-a67f-47bd-91bf-b3a170d51480 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4 Jul 03 01:21:34 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:34 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a971c02-ac90-4517-b93c-8f160739af57_8kvck3mwdevstack@QuobyteHD Jul 03 01:21:34 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:35 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a971c02-ac90-4517-b93c-8f160739af57_8kvck3mwdevstack@QuobyteHD" returned: 0 in 0.794s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a971c02-ac90-4517-b93c-8f160739af57_8kvck3mwdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:35 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d8bcc994-2e92-4071-8386-5d4de1bbb659 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a858c34-a67f-47bd-91bf-b3a170d51480 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4" returned: 0 in 0.760s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:35 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-d8bcc994-2e92-4071-8386-5d4de1bbb659 tempest-VolumesSnapshotTestJSON-1487329281 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4 is being set with open permissions: ugo+rw Jul 03 01:21:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d8bcc994-2e92-4071-8386-5d4de1bbb659 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:35 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4 Jul 03 01:21:35 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:35 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a971c02-ac90-4517-b93c-8f160739af57_8kvck3mwdevstack@QuobyteHD Jul 03 01:21:35 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:35 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d8bcc994-2e92-4071-8386-5d4de1bbb659 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4" returned: 0 in 0.689s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d8bcc994-2e92-4071-8386-5d4de1bbb659 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:35 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a971c02-ac90-4517-b93c-8f160739af57_8kvck3mwdevstack@QuobyteHD" returned: 1 in 0.793s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a971c02-ac90-4517-b93c-8f160739af57_8kvck3mwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:21:35 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] 0a971c02-ac90-4517-b93c-8f160739af57 was raw, converting to raw {{(pid=86772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 01:21:35 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.info Jul 03 01:21:35 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0a971c02-ac90-4517-b93c-8f160739af57_8kvck3mwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:35 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0a971c02-ac90-4517-b93c-8f160739af57_8kvck3mwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce Jul 03 01:21:35 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:36 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d8bcc994-2e92-4071-8386-5d4de1bbb659 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.info" returned: 0 in 0.703s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:36 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-d8bcc994-2e92-4071-8386-5d4de1bbb659 tempest-VolumesSnapshotTestJSON-1487329281 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.info is being set with open permissions: ugo+rw Jul 03 01:21:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d8bcc994-2e92-4071-8386-5d4de1bbb659 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:36 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.info Jul 03 01:21:36 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:36 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0a971c02-ac90-4517-b93c-8f160739af57_8kvck3mwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce" returned: 0 in 0.758s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:36 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0a971c02-ac90-4517-b93c-8f160739af57_8kvck3mwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:21:36 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 01:21:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:36 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce 1G Jul 03 01:21:36 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:37 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d8bcc994-2e92-4071-8386-5d4de1bbb659 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.info" returned: 0 in 0.727s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d8bcc994-2e92-4071-8386-5d4de1bbb659 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.649s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:37 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d8bcc994-2e92-4071-8386-5d4de1bbb659 tempest-VolumesSnapshotTestJSON-1487329281 None] Create snapshot completed successfully Jul 03 01:21:37 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce 1G" returned: 0 in 0.775s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:37 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[010afa4a-98f1-42a7-bbdb-e7905e07a5f7]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:37 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce Jul 03 01:21:37 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:38 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce" returned: 0 in 0.813s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:38 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce Jul 03 01:21:38 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Flow 'volume_create_manager' (1f363afd-2784-48be-bbfb-f05b7cef7172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a84427-8c76-4865-9386-3d9ae7ed3ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a84427-8c76-4865-9386-3d9ae7ed3ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1447299667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0505e301-3633-49cc-862c-88ecf5a3d3ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d26f56b8034d6d962d96784784199e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:21:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:21:38Z,use_quota=True,user_id='3ca48520154f47179f254f3272ab50e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cbc9ef7-fd71-42db-b83f-cdc7b901518a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cbc9ef7-fd71-42db-b83f-cdc7b901518a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fda4fb0b-3e71-4a86-8afa-bc1cd308d418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fda4fb0b-3e71-4a86-8afa-bc1cd308d418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0505e301-3633-49cc-862c-88ecf5a3d3ac', 'volume_name': 'volume-0505e301-3633-49cc-862c-88ecf5a3d3ac', 'volume_size': 2, 'snapshot_id': '3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a0c3e50-1049-4049-8898-70d7a7c18284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a0c3e50-1049-4049-8898-70d7a7c18284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (421fee67-9551-4e54-92ee-d73dee18cece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:38 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Volume 0505e301-3633-49cc-862c-88ecf5a3d3ac: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0505e301-3633-49cc-862c-88ecf5a3d3ac', 'volume_size': 2, 'snapshot_id': '3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4'} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "cinder-quobyte-3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4-0505e301-3633-49cc-862c-88ecf5a3d3ac" by "_create_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4-0505e301-3633-49cc-862c-88ecf5a3d3ac" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Creating volume 0505e301-3633-49cc-862c-88ecf5a3d3ac from snapshot 3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4 {{(pid=86772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "cinder-quobyte-0505e301-3633-49cc-862c-88ecf5a3d3ac" by "_copy_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-0505e301-3633-49cc-862c-88ecf5a3d3ac" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] snapshot: 3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4, volume: 0505e301-3633-49cc-862c-88ecf5a3d3ac, {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[964fcd03-67fe-46fb-aa62-291b66ef8ba5]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:38 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4 Jul 03 01:21:38 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:39 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce" returned: 1 in 0.838s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:21:39 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Downloaded image 0a971c02-ac90-4517-b93c-8f160739af57 ((None, [{'url': 'file:///opt/stack/data/glance/images/0a971c02-ac90-4517-b93c-8f160739af57', 'metadata': {}}])) to volume de6edfe8-fcee-4059-8e9c-244121c510ce successfully. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 01:21:39 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Temporary image 0a971c02-ac90-4517-b93c-8f160739af57 for user ef5f5fc2c8a74c448951bfdfbce90e99 is deleted. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 01:21:39 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Marking volume de6edfe8-fcee-4059-8e9c-244121c510ce as bootable. {{(pid=86772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 01:21:39 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Copying metadata from image 0a971c02-ac90-4517-b93c-8f160739af57 to de6edfe8-fcee-4059-8e9c-244121c510ce. {{(pid=86772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 01:21:39 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Creating volume glance metadata for volume de6edfe8-fcee-4059-8e9c-244121c510ce backed by image 0a971c02-ac90-4517-b93c-8f160739af57 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0a971c02-ac90-4517-b93c-8f160739af57', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5e81dc555376b8128311e8cb476cd284', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 01:21:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a6038e-ae12-4414-8e4a-72574b5ebea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de6edfe8-fcee-4059-8e9c-244121c510ce', 'volume_size': 1, 'image_id': '0a971c02-ac90-4517-b93c-8f160739af57', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a971c02-ac90-4517-b93c-8f160739af57', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e81dc555376b8128311e8cb476cd284', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6f1d31f346a9410288b4c6523d5fbdb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c6f2aabc85fd7b73f98625424b93ca9e114c0d041fa19faa0e6a572c01520e7e41d2bf2b189d97d666ac9d507166df84d7ad1b54a7f697f9c27875417f993dd5', 'id': '0a971c02-ac90-4517-b93c-8f160739af57', 'created_at': datetime.datetime(2026, 7, 2, 23, 21, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 21, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a971c02-ac90-4517-b93c-8f160739af57/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0f6f66-2870-431c-ad06-15769b4ffe54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:39 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Volume volume-de6edfe8-fcee-4059-8e9c-244121c510ce (de6edfe8-fcee-4059-8e9c-244121c510ce): created successfully Jul 03 01:21:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0f6f66-2870-431c-ad06-15769b4ffe54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Flow 'volume_create_manager' (3cd87325-46fa-4108-a527-b4387b04388b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:21:39 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-904f4c56-1a64-4100-87db-30c8ebde5ba1 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Created volume successfully. Jul 03 01:21:39 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4" returned: 0 in 0.814s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a858c34-a67f-47bd-91bf-b3a170d51480(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:21:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480 {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 01:21:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Creating direct copy from snapshot {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 01:21:39 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[500d21fc-aa3d-469d-bec9-ecbef6e1b9d7]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:39 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480 Jul 03 01:21:39 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-74f0faa5-343a-48a9-936b-6c06d6cc9e46 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Acquiring lock "cinder-de6edfe8-fcee-4059-8e9c-244121c510ce-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-74f0faa5-343a-48a9-936b-6c06d6cc9e46 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Lock "cinder-de6edfe8-fcee-4059-8e9c-244121c510ce-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-74f0faa5-343a-48a9-936b-6c06d6cc9e46 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Acquiring lock "cinder-quobyte-de6edfe8-fcee-4059-8e9c-244121c510ce" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-74f0faa5-343a-48a9-936b-6c06d6cc9e46 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Lock "cinder-quobyte-de6edfe8-fcee-4059-8e9c-244121c510ce" acquired by "delete_volume" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:40 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7dab29-cd34-4927-abce-541ef7092714]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-74f0faa5-343a-48a9-936b-6c06d6cc9e46 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:40 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce Jul 03 01:21:40 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:40 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480" returned: 0 in 0.821s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:40 devstack cinder-volume[86772]: DEBUG cinder.utils [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Path /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0505e301-3633-49cc-862c-88ecf5a3d3ac not found in is_blk_device check {{(pid=86772) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 01:21:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0505e301-3633-49cc-862c-88ecf5a3d3ac {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:40 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0505e301-3633-49cc-862c-88ecf5a3d3ac Jul 03 01:21:40 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:40 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-74f0faa5-343a-48a9-936b-6c06d6cc9e46 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce" returned: 0 in 0.817s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-74f0faa5-343a-48a9-936b-6c06d6cc9e46 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:41 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce Jul 03 01:21:41 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:42 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-74f0faa5-343a-48a9-936b-6c06d6cc9e46 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce" returned: 1 in 1.384s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-74f0faa5-343a-48a9-936b-6c06d6cc9e46 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:21:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-74f0faa5-343a-48a9-936b-6c06d6cc9e46 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:42 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce Jul 03 01:21:42 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:44 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-74f0faa5-343a-48a9-936b-6c06d6cc9e46 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-de6edfe8-fcee-4059-8e9c-244121c510ce" returned: 0 in 1.938s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-74f0faa5-343a-48a9-936b-6c06d6cc9e46 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Lock "cinder-quobyte-de6edfe8-fcee-4059-8e9c-244121c510ce" released by "delete_volume" :: held 4.217s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:44 devstack cinder-volume[86772]: WARNING cinder.quota [None req-74f0faa5-343a-48a9-936b-6c06d6cc9e46 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:21:44 devstack cinder-volume[86772]: WARNING cinder.quota [None req-74f0faa5-343a-48a9-936b-6c06d6cc9e46 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 03 01:21:44 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-74f0faa5-343a-48a9-936b-6c06d6cc9e46 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Created reservations ['c4f885aa-1a3f-4c66-b71d-d957e8f25a60', '38d2e61a-82a9-48ff-a27c-d2f5f3cad1e8', 'f8ddac8a-8d6f-408d-83e6-98e10c6eba39', '23692ae8-beb5-4091-9a90-b8e68e514bcc'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:21:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-74f0faa5-343a-48a9-936b-6c06d6cc9e46 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-74f0faa5-343a-48a9-936b-6c06d6cc9e46 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-74f0faa5-343a-48a9-936b-6c06d6cc9e46 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:21:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-74f0faa5-343a-48a9-936b-6c06d6cc9e46 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:21:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-74f0faa5-343a-48a9-936b-6c06d6cc9e46 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-74f0faa5-343a-48a9-936b-6c06d6cc9e46 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:44 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:21:44 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:45 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0505e301-3633-49cc-862c-88ecf5a3d3ac" returned: 0 in 5.444s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:45 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb60a30-c665-4b07-a182-2ad5dc05011a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:45 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-74f0faa5-343a-48a9-936b-6c06d6cc9e46 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.341s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:45 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-74f0faa5-343a-48a9-936b-6c06d6cc9e46 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:21:45 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-74f0faa5-343a-48a9-936b-6c06d6cc9e46 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Deleted volume successfully. Jul 03 01:21:45 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480 Jul 03 01:21:45 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-74f0faa5-343a-48a9-936b-6c06d6cc9e46 tempest-VolumeAndVolumeTypeFromImageTest-450101168 None] Lock "cinder-de6edfe8-fcee-4059-8e9c-244121c510ce-delete_volume" released by "delete_volume" :: held 6.019s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:46 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480" returned: 0 in 0.950s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:46 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Image conversion details: src /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480, size 1024.00 MB, duration 5.45 sec, destination /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0505e301-3633-49cc-862c-88ecf5a3d3ac {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:21:46 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Converted 1024.00 MB image at 188.04 MB/s Jul 03 01:21:46 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0505e301-3633-49cc-862c-88ecf5a3d3ac is being set with open permissions: ugo+rw Jul 03 01:21:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0505e301-3633-49cc-862c-88ecf5a3d3ac {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:46 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0505e301-3633-49cc-862c-88ecf5a3d3ac Jul 03 01:21:46 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:47 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0505e301-3633-49cc-862c-88ecf5a3d3ac" returned: 0 in 0.726s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-0505e301-3633-49cc-862c-88ecf5a3d3ac" released by "_copy_volume_from_snapshot" :: held 8.855s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4-0505e301-3633-49cc-862c-88ecf5a3d3ac" released by "_create_volume_from_snapshot" :: held 8.887s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.903s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (421fee67-9551-4e54-92ee-d73dee18cece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0505e301-3633-49cc-862c-88ecf5a3d3ac', 'volume_size': 2, 'snapshot_id': '3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11da57dd-b0ee-43a3-a748-93c6ecf2700f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:47 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Volume volume-0505e301-3633-49cc-862c-88ecf5a3d3ac (0505e301-3633-49cc-862c-88ecf5a3d3ac): created successfully Jul 03 01:21:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11da57dd-b0ee-43a3-a748-93c6ecf2700f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Flow 'volume_create_manager' (1f363afd-2784-48be-bbfb-f05b7cef7172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:21:47 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-65cc1fed-c68f-4251-938f-e8e9b221bad0 tempest-VolumesSnapshotTestJSON-1487329281 None] Created volume successfully. Jul 03 01:21:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-326bd3a5-ea9a-415b-9f1d-75c4417e9b77 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "cinder-0505e301-3633-49cc-862c-88ecf5a3d3ac-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-326bd3a5-ea9a-415b-9f1d-75c4417e9b77 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-0505e301-3633-49cc-862c-88ecf5a3d3ac-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-326bd3a5-ea9a-415b-9f1d-75c4417e9b77 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "cinder-quobyte-0505e301-3633-49cc-862c-88ecf5a3d3ac" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-326bd3a5-ea9a-415b-9f1d-75c4417e9b77 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-0505e301-3633-49cc-862c-88ecf5a3d3ac" acquired by "delete_volume" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:48 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f09b2a-205b-4dc0-bd69-ceea3528e983]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-326bd3a5-ea9a-415b-9f1d-75c4417e9b77 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0505e301-3633-49cc-862c-88ecf5a3d3ac {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:48 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0505e301-3633-49cc-862c-88ecf5a3d3ac Jul 03 01:21:48 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:49 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-326bd3a5-ea9a-415b-9f1d-75c4417e9b77 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0505e301-3633-49cc-862c-88ecf5a3d3ac" returned: 0 in 0.789s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-326bd3a5-ea9a-415b-9f1d-75c4417e9b77 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0505e301-3633-49cc-862c-88ecf5a3d3ac {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:49 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0505e301-3633-49cc-862c-88ecf5a3d3ac Jul 03 01:21:49 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:49 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:21:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Flow 'volume_create_manager' (b24d10b8-1865-466a-aaa2-f8e3bc4f25c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:21:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9091ae7c-4c3a-4050-932f-ed5eaee57044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9091ae7c-4c3a-4050-932f-ed5eaee57044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7320b7c2-fc41-4bab-9936-f3b235b781a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b40ed5bf953c481794ad8b1ee9b96887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:21:50Z,use_quota=True,user_id='21d4cedce8254efa930f3bea2b281ddc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47fe341-dc39-4859-9ea1-59b3b143c6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47fe341-dc39-4859-9ea1-59b3b143c6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b9042d-1ff6-4367-a6ae-cdd461bdb544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b9042d-1ff6-4367-a6ae-cdd461bdb544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7320b7c2-fc41-4bab-9936-f3b235b781a6', 'volume_name': 'volume-7320b7c2-fc41-4bab-9936-f3b235b781a6', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beaa06dd-fef8-480d-ba14-8337b89dfdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beaa06dd-fef8-480d-ba14-8337b89dfdec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (019aa147-9443-4c26-91f6-944ae93c3e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:49 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Volume 7320b7c2-fc41-4bab-9936-f3b235b781a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7320b7c2-fc41-4bab-9936-f3b235b781a6', 'volume_size': 1} Jul 03 01:21:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7320b7c2-fc41-4bab-9936-f3b235b781a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b40ed5bf953c481794ad8b1ee9b96887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:21:50Z,use_quota=True,user_id='21d4cedce8254efa930f3bea2b281ddc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:21:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Creating volume 7320b7c2-fc41-4bab-9936-f3b235b781a6 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:21:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:21:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:21:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:21:49 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:21:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7320b7c2-fc41-4bab-9936-f3b235b781a6 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:49 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7320b7c2-fc41-4bab-9936-f3b235b781a6 1073741824 Jul 03 01:21:49 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:50 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-326bd3a5-ea9a-415b-9f1d-75c4417e9b77 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0505e301-3633-49cc-862c-88ecf5a3d3ac" returned: 0 in 0.665s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-326bd3a5-ea9a-415b-9f1d-75c4417e9b77 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-0505e301-3633-49cc-862c-88ecf5a3d3ac" released by "delete_volume" :: held 1.491s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:50 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-326bd3a5-ea9a-415b-9f1d-75c4417e9b77 tempest-VolumesSnapshotTestJSON-1487329281 None] Created reservations ['179393d5-6be2-4b22-a88a-ef7f4806aa52', '37013c9f-3c9a-4725-994a-425bb1857599', '43c501d2-d089-4ff2-b249-46bb3c72e9f5', 'f0ab075a-1717-4227-ad09-68b383004e61'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:21:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-326bd3a5-ea9a-415b-9f1d-75c4417e9b77 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-326bd3a5-ea9a-415b-9f1d-75c4417e9b77 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-326bd3a5-ea9a-415b-9f1d-75c4417e9b77 tempest-VolumesSnapshotTestJSON-1487329281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:21:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-326bd3a5-ea9a-415b-9f1d-75c4417e9b77 tempest-VolumesSnapshotTestJSON-1487329281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:21:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-326bd3a5-ea9a-415b-9f1d-75c4417e9b77 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-326bd3a5-ea9a-415b-9f1d-75c4417e9b77 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:50 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:21:50 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:50 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7320b7c2-fc41-4bab-9936-f3b235b781a6 1073741824" returned: 0 in 0.817s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7320b7c2-fc41-4bab-9936-f3b235b781a6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:50 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7320b7c2-fc41-4bab-9936-f3b235b781a6 Jul 03 01:21:50 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4d1d8176-68cc-4930-988d-e6b2b3f29ed2 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "cinder-3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4d1d8176-68cc-4930-988d-e6b2b3f29ed2 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.084s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4d1d8176-68cc-4930-988d-e6b2b3f29ed2 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "cinder-quobyte-4a858c34-a67f-47bd-91bf-b3a170d51480" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:50 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-326bd3a5-ea9a-415b-9f1d-75c4417e9b77 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.719s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:50 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-326bd3a5-ea9a-415b-9f1d-75c4417e9b77 tempest-VolumesSnapshotTestJSON-1487329281 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:21:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4d1d8176-68cc-4930-988d-e6b2b3f29ed2 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-4a858c34-a67f-47bd-91bf-b3a170d51480" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4d1d8176-68cc-4930-988d-e6b2b3f29ed2 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "cinder-quobyte-3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:50 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-326bd3a5-ea9a-415b-9f1d-75c4417e9b77 tempest-VolumesSnapshotTestJSON-1487329281 None] Deleted volume successfully. Jul 03 01:21:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4d1d8176-68cc-4930-988d-e6b2b3f29ed2 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4d1d8176-68cc-4930-988d-e6b2b3f29ed2 tempest-VolumesSnapshotTestJSON-1487329281 None] Deleting offline snapshot 3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4 of volume 4a858c34-a67f-47bd-91bf-b3a170d51480 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:21:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4d1d8176-68cc-4930-988d-e6b2b3f29ed2 tempest-VolumesSnapshotTestJSON-1487329281 None] snapshot_file for this snap is: volume-4a858c34-a67f-47bd-91bf-b3a170d51480.3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:21:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-326bd3a5-ea9a-415b-9f1d-75c4417e9b77 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-0505e301-3633-49cc-862c-88ecf5a3d3ac-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:51 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[49783e1c-b275-4dce-9f14-777c1db4ac1d]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4d1d8176-68cc-4930-988d-e6b2b3f29ed2 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:51 devstack sudo[104629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4 Jul 03 01:21:51 devstack sudo[104629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:51 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7320b7c2-fc41-4bab-9936-f3b235b781a6" returned: 0 in 0.711s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:51 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:21:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (019aa147-9443-4c26-91f6-944ae93c3e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7320b7c2-fc41-4bab-9936-f3b235b781a6', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6911dedf-e338-4b30-824f-86a1fb60fba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:51 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Volume volume-7320b7c2-fc41-4bab-9936-f3b235b781a6 (7320b7c2-fc41-4bab-9936-f3b235b781a6): created successfully Jul 03 01:21:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6911dedf-e338-4b30-824f-86a1fb60fba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:51 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Flow 'volume_create_manager' (b24d10b8-1865-466a-aaa2-f8e3bc4f25c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:21:51 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-bb84b522-cc38-4e81-8132-ca82f49f0104 tempest-CinderUnicodeTest-2118930680 None] Created volume successfully. Jul 03 01:21:51 devstack sudo[104629]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4d1d8176-68cc-4930-988d-e6b2b3f29ed2 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4" returned: 0 in 0.754s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:51 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4d1d8176-68cc-4930-988d-e6b2b3f29ed2 tempest-VolumesSnapshotTestJSON-1487329281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a858c34-a67f-47bd-91bf-b3a170d51480(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:21:51 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf89487c-be92-44bd-9e40-961d7a4aea32]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4d1d8176-68cc-4930-988d-e6b2b3f29ed2 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:51 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480 Jul 03 01:21:51 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:52 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:21:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Flow 'volume_create_manager' (3d1e2bcd-f436-4fb3-a91c-c7483e527538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:21:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (470b42e5-09fb-4e61-920c-7befff20e6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (470b42e5-09fb-4e61-920c-7befff20e6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:21:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1238497232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b49fad5-18aa-4c99-ae1e-206d0d71c598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b40ed5bf953c481794ad8b1ee9b96887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:21:52Z,use_quota=True,user_id='21d4cedce8254efa930f3bea2b281ddc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4887645-bef3-4439-8850-129ea45787f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4887645-bef3-4439-8850-129ea45787f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87968659-5552-4f62-9ed4-28300dbcd5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87968659-5552-4f62-9ed4-28300dbcd5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b49fad5-18aa-4c99-ae1e-206d0d71c598', 'volume_name': 'volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a91293-c42e-4304-bfee-c7cbe37bab04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a91293-c42e-4304-bfee-c7cbe37bab04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d56183-3a33-4923-9332-5e9c9de9b536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:52 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Volume 9b49fad5-18aa-4c99-ae1e-206d0d71c598: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598', 'volume_size': 1} Jul 03 01:21:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:21:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1238497232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b49fad5-18aa-4c99-ae1e-206d0d71c598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b40ed5bf953c481794ad8b1ee9b96887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:21:52Z,use_quota=True,user_id='21d4cedce8254efa930f3bea2b281ddc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:21:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Creating volume 9b49fad5-18aa-4c99-ae1e-206d0d71c598 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:21:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:21:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:21:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:21:52 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:21:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:52 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598 1073741824 Jul 03 01:21:52 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:52 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4d1d8176-68cc-4930-988d-e6b2b3f29ed2 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480" returned: 0 in 0.786s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4d1d8176-68cc-4930-988d-e6b2b3f29ed2 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:52 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4 Jul 03 01:21:52 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:53 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598 1073741824" returned: 0 in 0.865s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:53 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4d1d8176-68cc-4930-988d-e6b2b3f29ed2 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4" returned: 0 in 0.790s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4d1d8176-68cc-4930-988d-e6b2b3f29ed2 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:53 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4 Jul 03 01:21:53 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:53 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598 Jul 03 01:21:53 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:54 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4d1d8176-68cc-4930-988d-e6b2b3f29ed2 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480.3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4" returned: 0 in 0.651s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:54 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598" returned: 0 in 0.670s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:21:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4d1d8176-68cc-4930-988d-e6b2b3f29ed2 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4" released by "_delete_snapshot" :: held 3.106s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4d1d8176-68cc-4930-988d-e6b2b3f29ed2 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-4a858c34-a67f-47bd-91bf-b3a170d51480" released by "delete_snapshot" :: held 3.136s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d56183-3a33-4923-9332-5e9c9de9b536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1076eb14-abb2-4dc7-bf4f-71b53e9329b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:54 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Volume volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598 (9b49fad5-18aa-4c99-ae1e-206d0d71c598): created successfully Jul 03 01:21:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1076eb14-abb2-4dc7-bf4f-71b53e9329b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:54 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Flow 'volume_create_manager' (3d1e2bcd-f436-4fb3-a91c-c7483e527538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:21:54 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1257a13a-15a8-4fe4-ac51-7dc3ee872a5c tempest-CinderUnicodeTest-2118930680 None] Created volume successfully. Jul 03 01:21:54 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-4d1d8176-68cc-4930-988d-e6b2b3f29ed2 tempest-VolumesSnapshotTestJSON-1487329281 None] Created reservations ['7fb3c4c4-19da-495e-bd83-d3abe9d0b0d9', '06df9c06-c8dd-40f9-a663-b350232e3da8', '75d3a8ea-2820-46e4-bfbc-94d8bb281e6c', 'b32c0e7b-71c5-476d-be23-9f35d00adf8e'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:21:54 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4d1d8176-68cc-4930-988d-e6b2b3f29ed2 tempest-VolumesSnapshotTestJSON-1487329281 None] Delete snapshot completed successfully. Jul 03 01:21:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4d1d8176-68cc-4930-988d-e6b2b3f29ed2 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-3e9ac113-b616-4d5e-b02a-9b0cb97fd8a4-delete_snapshot" released by "delete_snapshot" :: held 3.311s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-df7eed2c-b1c7-4705-8970-d48bf8d05976 tempest-CinderUnicodeTest-2118930680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-df7eed2c-b1c7-4705-8970-d48bf8d05976 tempest-CinderUnicodeTest-2118930680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-df7eed2c-b1c7-4705-8970-d48bf8d05976 tempest-CinderUnicodeTest-2118930680 None] Creating offline snapshot 5388de61-c5f5-4967-874e-18d43b2b82fb of volume 9b49fad5-18aa-4c99-ae1e-206d0d71c598 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:21:54 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2268a6-2031-4625-ad97-c7bdd04f3dd3]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-df7eed2c-b1c7-4705-8970-d48bf8d05976 tempest-CinderUnicodeTest-2118930680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:54 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598 Jul 03 01:21:54 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f33e6fa3-d342-4968-b720-0e6e82d5c623 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "cinder-4a858c34-a67f-47bd-91bf-b3a170d51480-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f33e6fa3-d342-4968-b720-0e6e82d5c623 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-4a858c34-a67f-47bd-91bf-b3a170d51480-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f33e6fa3-d342-4968-b720-0e6e82d5c623 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "cinder-quobyte-4a858c34-a67f-47bd-91bf-b3a170d51480" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f33e6fa3-d342-4968-b720-0e6e82d5c623 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-4a858c34-a67f-47bd-91bf-b3a170d51480" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:55 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a526a9-66f8-48b7-9896-b0e88b298430]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:21:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f33e6fa3-d342-4968-b720-0e6e82d5c623 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:55 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480 Jul 03 01:21:55 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:55 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-df7eed2c-b1c7-4705-8970-d48bf8d05976 tempest-CinderUnicodeTest-2118930680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598" returned: 0 in 0.803s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-df7eed2c-b1c7-4705-8970-d48bf8d05976 tempest-CinderUnicodeTest-2118930680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.5388de61-c5f5-4967-874e-18d43b2b82fb 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:55 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.5388de61-c5f5-4967-874e-18d43b2b82fb 1G Jul 03 01:21:55 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:56 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f33e6fa3-d342-4968-b720-0e6e82d5c623 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480" returned: 0 in 0.770s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f33e6fa3-d342-4968-b720-0e6e82d5c623 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:56 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480 Jul 03 01:21:56 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:56 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-df7eed2c-b1c7-4705-8970-d48bf8d05976 tempest-CinderUnicodeTest-2118930680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.5388de61-c5f5-4967-874e-18d43b2b82fb 1G" returned: 0 in 0.840s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-df7eed2c-b1c7-4705-8970-d48bf8d05976 tempest-CinderUnicodeTest-2118930680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.5388de61-c5f5-4967-874e-18d43b2b82fb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:56 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.5388de61-c5f5-4967-874e-18d43b2b82fb Jul 03 01:21:56 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:56 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f33e6fa3-d342-4968-b720-0e6e82d5c623 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4a858c34-a67f-47bd-91bf-b3a170d51480" returned: 0 in 0.642s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f33e6fa3-d342-4968-b720-0e6e82d5c623 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-4a858c34-a67f-47bd-91bf-b3a170d51480" released by "delete_volume" :: held 1.485s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:56 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-f33e6fa3-d342-4968-b720-0e6e82d5c623 tempest-VolumesSnapshotTestJSON-1487329281 None] Created reservations ['56cac590-35ec-4ad8-9271-5cba5819a5e0', '9df4bbb1-5c15-464b-a82c-109f61714b6a', 'b7ea0e02-95e4-457e-b66d-53a75dafb70a', '8178d666-a67e-45f6-8327-233083304e40'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:21:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f33e6fa3-d342-4968-b720-0e6e82d5c623 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f33e6fa3-d342-4968-b720-0e6e82d5c623 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f33e6fa3-d342-4968-b720-0e6e82d5c623 tempest-VolumesSnapshotTestJSON-1487329281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:21:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f33e6fa3-d342-4968-b720-0e6e82d5c623 tempest-VolumesSnapshotTestJSON-1487329281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:21:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f33e6fa3-d342-4968-b720-0e6e82d5c623 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f33e6fa3-d342-4968-b720-0e6e82d5c623 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:56 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:21:56 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:57 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-df7eed2c-b1c7-4705-8970-d48bf8d05976 tempest-CinderUnicodeTest-2118930680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.5388de61-c5f5-4967-874e-18d43b2b82fb" returned: 0 in 0.731s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:57 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-df7eed2c-b1c7-4705-8970-d48bf8d05976 tempest-CinderUnicodeTest-2118930680 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.5388de61-c5f5-4967-874e-18d43b2b82fb is being set with open permissions: ugo+rw Jul 03 01:21:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-df7eed2c-b1c7-4705-8970-d48bf8d05976 tempest-CinderUnicodeTest-2118930680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.5388de61-c5f5-4967-874e-18d43b2b82fb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:57 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.5388de61-c5f5-4967-874e-18d43b2b82fb Jul 03 01:21:57 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:57 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f33e6fa3-d342-4968-b720-0e6e82d5c623 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.687s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:57 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-f33e6fa3-d342-4968-b720-0e6e82d5c623 tempest-VolumesSnapshotTestJSON-1487329281 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:21:57 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f33e6fa3-d342-4968-b720-0e6e82d5c623 tempest-VolumesSnapshotTestJSON-1487329281 None] Deleted volume successfully. Jul 03 01:21:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f33e6fa3-d342-4968-b720-0e6e82d5c623 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-4a858c34-a67f-47bd-91bf-b3a170d51480-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:21:57 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-df7eed2c-b1c7-4705-8970-d48bf8d05976 tempest-CinderUnicodeTest-2118930680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.5388de61-c5f5-4967-874e-18d43b2b82fb" returned: 0 in 0.673s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-df7eed2c-b1c7-4705-8970-d48bf8d05976 tempest-CinderUnicodeTest-2118930680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:57 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.info Jul 03 01:21:57 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:57 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:21:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Flow 'volume_create_manager' (5727ce54-ffac-4b29-afb6-262ab2523d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:21:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ce4aec-2bfe-4a02-86f8-87e6cd55c8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ce4aec-2bfe-4a02-86f8-87e6cd55c8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1519611995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eef0442-2908-4309-b9df-86f7f4d470b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d26f56b8034d6d962d96784784199e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:21:58Z,use_quota=True,user_id='3ca48520154f47179f254f3272ab50e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:57 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d643d4e-d0c4-4bb2-b2d8-2f18e8140ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d643d4e-d0c4-4bb2-b2d8-2f18e8140ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7aed92-d247-4370-b7cb-2b31c27ed077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7aed92-d247-4370-b7cb-2b31c27ed077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eef0442-2908-4309-b9df-86f7f4d470b7', 'volume_name': 'volume-3eef0442-2908-4309-b9df-86f7f4d470b7', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4fe9ac1-e98c-4551-a183-5e1ef7eac7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4fe9ac1-e98c-4551-a183-5e1ef7eac7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:21:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea0e74e9-1340-4dc5-a550-db2312e492e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:21:58 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Volume 3eef0442-2908-4309-b9df-86f7f4d470b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eef0442-2908-4309-b9df-86f7f4d470b7', 'volume_size': 1} Jul 03 01:21:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:58 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-df7eed2c-b1c7-4705-8970-d48bf8d05976 tempest-CinderUnicodeTest-2118930680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.info" returned: 0 in 0.636s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:58 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-df7eed2c-b1c7-4705-8970-d48bf8d05976 tempest-CinderUnicodeTest-2118930680 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.info is being set with open permissions: ugo+rw Jul 03 01:21:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-df7eed2c-b1c7-4705-8970-d48bf8d05976 tempest-CinderUnicodeTest-2118930680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:58 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.info Jul 03 01:21:58 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:59 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-df7eed2c-b1c7-4705-8970-d48bf8d05976 tempest-CinderUnicodeTest-2118930680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.info" returned: 0 in 0.636s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-df7eed2c-b1c7-4705-8970-d48bf8d05976 tempest-CinderUnicodeTest-2118930680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.408s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.020s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1519611995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eef0442-2908-4309-b9df-86f7f4d470b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d26f56b8034d6d962d96784784199e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:21:58Z,use_quota=True,user_id='3ca48520154f47179f254f3272ab50e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:21:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Creating volume 3eef0442-2908-4309-b9df-86f7f4d470b7 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:21:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:21:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:21:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:21:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:21:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:21:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:21:59 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:21:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:59 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7 1073741824 Jul 03 01:21:59 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:59 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-df7eed2c-b1c7-4705-8970-d48bf8d05976 tempest-CinderUnicodeTest-2118930680 None] Create snapshot completed successfully Jul 03 01:21:59 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Jul 03 01:21:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7 1073741824" returned: 0 in 0.813s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:21:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b94476a6-efbf-4e23-8a76-ad6f9f9eb1a0 tempest-CinderUnicodeTest-2118930680 None] Acquiring lock "cinder-5388de61-c5f5-4967-874e-18d43b2b82fb-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:21:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b94476a6-efbf-4e23-8a76-ad6f9f9eb1a0 tempest-CinderUnicodeTest-2118930680 None] Lock "cinder-5388de61-c5f5-4967-874e-18d43b2b82fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b94476a6-efbf-4e23-8a76-ad6f9f9eb1a0 tempest-CinderUnicodeTest-2118930680 None] Acquiring lock "cinder-quobyte-9b49fad5-18aa-4c99-ae1e-206d0d71c598" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:59 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7 Jul 03 01:21:59 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:21:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b94476a6-efbf-4e23-8a76-ad6f9f9eb1a0 tempest-CinderUnicodeTest-2118930680 None] Lock "cinder-quobyte-9b49fad5-18aa-4c99-ae1e-206d0d71c598" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b94476a6-efbf-4e23-8a76-ad6f9f9eb1a0 tempest-CinderUnicodeTest-2118930680 None] Acquiring lock "cinder-quobyte-5388de61-c5f5-4967-874e-18d43b2b82fb" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:21:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b94476a6-efbf-4e23-8a76-ad6f9f9eb1a0 tempest-CinderUnicodeTest-2118930680 None] Lock "cinder-quobyte-5388de61-c5f5-4967-874e-18d43b2b82fb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:21:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-b94476a6-efbf-4e23-8a76-ad6f9f9eb1a0 tempest-CinderUnicodeTest-2118930680 None] Deleting offline snapshot 5388de61-c5f5-4967-874e-18d43b2b82fb of volume 9b49fad5-18aa-4c99-ae1e-206d0d71c598 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:22:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-b94476a6-efbf-4e23-8a76-ad6f9f9eb1a0 tempest-CinderUnicodeTest-2118930680 None] snapshot_file for this snap is: volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.5388de61-c5f5-4967-874e-18d43b2b82fb {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:22:00 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f693da-a709-4403-ad1e-b58ee19660ff]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:22:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b94476a6-efbf-4e23-8a76-ad6f9f9eb1a0 tempest-CinderUnicodeTest-2118930680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.5388de61-c5f5-4967-874e-18d43b2b82fb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:00 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.5388de61-c5f5-4967-874e-18d43b2b82fb Jul 03 01:22:00 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:00 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7" returned: 0 in 0.680s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:22:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:22:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea0e74e9-1340-4dc5-a550-db2312e492e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eef0442-2908-4309-b9df-86f7f4d470b7', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:22:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62f66a37-8e4b-4f78-892c-290035a6f660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:22:00 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Volume volume-3eef0442-2908-4309-b9df-86f7f4d470b7 (3eef0442-2908-4309-b9df-86f7f4d470b7): created successfully Jul 03 01:22:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62f66a37-8e4b-4f78-892c-290035a6f660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:22:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Flow 'volume_create_manager' (5727ce54-ffac-4b29-afb6-262ab2523d7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:22:00 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-96595694-2512-4dfc-92ed-24a26d216c45 tempest-VolumesSnapshotTestJSON-1487329281 None] Created volume successfully. Jul 03 01:22:00 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b94476a6-efbf-4e23-8a76-ad6f9f9eb1a0 tempest-CinderUnicodeTest-2118930680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.5388de61-c5f5-4967-874e-18d43b2b82fb" returned: 0 in 0.774s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-b94476a6-efbf-4e23-8a76-ad6f9f9eb1a0 tempest-CinderUnicodeTest-2118930680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:22:00 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ff036a-3c10-45ec-9e8b-6b64abe3e974]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:22:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b94476a6-efbf-4e23-8a76-ad6f9f9eb1a0 tempest-CinderUnicodeTest-2118930680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:00 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598 Jul 03 01:22:00 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6f1fd26c-fef5-4f04-a839-7cc24ed5e5d6 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:22:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6f1fd26c-fef5-4f04-a839-7cc24ed5e5d6 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:22:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6f1fd26c-fef5-4f04-a839-7cc24ed5e5d6 tempest-VolumesSnapshotTestJSON-1487329281 None] Creating offline snapshot 51ad580a-9a9e-4eec-9f7a-605d95a0e881 of volume 3eef0442-2908-4309-b9df-86f7f4d470b7 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:22:01 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d93bbf-4db3-4f83-8571-6523ce087c92]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:22:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6f1fd26c-fef5-4f04-a839-7cc24ed5e5d6 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:01 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7 Jul 03 01:22:01 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:01 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b94476a6-efbf-4e23-8a76-ad6f9f9eb1a0 tempest-CinderUnicodeTest-2118930680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598" returned: 0 in 0.774s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b94476a6-efbf-4e23-8a76-ad6f9f9eb1a0 tempest-CinderUnicodeTest-2118930680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.5388de61-c5f5-4967-874e-18d43b2b82fb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:01 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.5388de61-c5f5-4967-874e-18d43b2b82fb Jul 03 01:22:01 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:02 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6f1fd26c-fef5-4f04-a839-7cc24ed5e5d6 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7" returned: 0 in 0.767s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6f1fd26c-fef5-4f04-a839-7cc24ed5e5d6 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.51ad580a-9a9e-4eec-9f7a-605d95a0e881 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:02 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.51ad580a-9a9e-4eec-9f7a-605d95a0e881 1G Jul 03 01:22:02 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:02 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b94476a6-efbf-4e23-8a76-ad6f9f9eb1a0 tempest-CinderUnicodeTest-2118930680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.5388de61-c5f5-4967-874e-18d43b2b82fb" returned: 0 in 0.726s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b94476a6-efbf-4e23-8a76-ad6f9f9eb1a0 tempest-CinderUnicodeTest-2118930680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.5388de61-c5f5-4967-874e-18d43b2b82fb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:02 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.5388de61-c5f5-4967-874e-18d43b2b82fb Jul 03 01:22:02 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:02 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6f1fd26c-fef5-4f04-a839-7cc24ed5e5d6 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.51ad580a-9a9e-4eec-9f7a-605d95a0e881 1G" returned: 0 in 0.762s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6f1fd26c-fef5-4f04-a839-7cc24ed5e5d6 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eef0442-2908-4309-b9df-86f7f4d470b7 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.51ad580a-9a9e-4eec-9f7a-605d95a0e881 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:02 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eef0442-2908-4309-b9df-86f7f4d470b7 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.51ad580a-9a9e-4eec-9f7a-605d95a0e881 Jul 03 01:22:02 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:02 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b94476a6-efbf-4e23-8a76-ad6f9f9eb1a0 tempest-CinderUnicodeTest-2118930680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598.5388de61-c5f5-4967-874e-18d43b2b82fb" returned: 0 in 0.675s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b94476a6-efbf-4e23-8a76-ad6f9f9eb1a0 tempest-CinderUnicodeTest-2118930680 None] Lock "cinder-quobyte-5388de61-c5f5-4967-874e-18d43b2b82fb" released by "_delete_snapshot" :: held 3.077s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b94476a6-efbf-4e23-8a76-ad6f9f9eb1a0 tempest-CinderUnicodeTest-2118930680 None] Lock "cinder-quobyte-9b49fad5-18aa-4c99-ae1e-206d0d71c598" released by "delete_snapshot" :: held 3.098s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:03 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-b94476a6-efbf-4e23-8a76-ad6f9f9eb1a0 tempest-CinderUnicodeTest-2118930680 None] Created reservations ['cc7b5179-d7ec-4e5e-88d0-2ff56b21af6d', 'd0f4b99c-efe6-4876-b790-65986f3a8183', '10d6668c-84cb-4414-9965-797a4d2be7e8', '72703910-7a3c-4e90-99b6-4b0c8b65dd22'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:22:03 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b94476a6-efbf-4e23-8a76-ad6f9f9eb1a0 tempest-CinderUnicodeTest-2118930680 None] Delete snapshot completed successfully. Jul 03 01:22:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b94476a6-efbf-4e23-8a76-ad6f9f9eb1a0 tempest-CinderUnicodeTest-2118930680 None] Lock "cinder-5388de61-c5f5-4967-874e-18d43b2b82fb-delete_snapshot" released by "delete_snapshot" :: held 3.229s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:03 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6f1fd26c-fef5-4f04-a839-7cc24ed5e5d6 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3eef0442-2908-4309-b9df-86f7f4d470b7 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.51ad580a-9a9e-4eec-9f7a-605d95a0e881" returned: 0 in 0.667s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:03 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-6f1fd26c-fef5-4f04-a839-7cc24ed5e5d6 tempest-VolumesSnapshotTestJSON-1487329281 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.51ad580a-9a9e-4eec-9f7a-605d95a0e881 is being set with open permissions: ugo+rw Jul 03 01:22:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6f1fd26c-fef5-4f04-a839-7cc24ed5e5d6 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.51ad580a-9a9e-4eec-9f7a-605d95a0e881 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:03 devstack sudo[104740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.51ad580a-9a9e-4eec-9f7a-605d95a0e881 Jul 03 01:22:03 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:04 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6f1fd26c-fef5-4f04-a839-7cc24ed5e5d6 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.51ad580a-9a9e-4eec-9f7a-605d95a0e881" returned: 0 in 0.618s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6f1fd26c-fef5-4f04-a839-7cc24ed5e5d6 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:04 devstack sudo[104743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.info Jul 03 01:22:04 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d09fbc80-adeb-40cb-abed-2d1493b81aff tempest-CinderUnicodeTest-2118930680 None] Acquiring lock "cinder-9b49fad5-18aa-4c99-ae1e-206d0d71c598-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:22:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d09fbc80-adeb-40cb-abed-2d1493b81aff tempest-CinderUnicodeTest-2118930680 None] Lock "cinder-9b49fad5-18aa-4c99-ae1e-206d0d71c598-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:22:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d09fbc80-adeb-40cb-abed-2d1493b81aff tempest-CinderUnicodeTest-2118930680 None] Acquiring lock "cinder-quobyte-9b49fad5-18aa-4c99-ae1e-206d0d71c598" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:22:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d09fbc80-adeb-40cb-abed-2d1493b81aff tempest-CinderUnicodeTest-2118930680 None] Lock "cinder-quobyte-9b49fad5-18aa-4c99-ae1e-206d0d71c598" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:22:04 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[32dedc7c-bc7a-4365-84c3-ed690a0a07c6]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:22:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d09fbc80-adeb-40cb-abed-2d1493b81aff tempest-CinderUnicodeTest-2118930680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:04 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598 Jul 03 01:22:04 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:04 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6f1fd26c-fef5-4f04-a839-7cc24ed5e5d6 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.info" returned: 0 in 0.692s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:04 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-6f1fd26c-fef5-4f04-a839-7cc24ed5e5d6 tempest-VolumesSnapshotTestJSON-1487329281 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.info is being set with open permissions: ugo+rw Jul 03 01:22:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6f1fd26c-fef5-4f04-a839-7cc24ed5e5d6 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:04 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.info Jul 03 01:22:04 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:05 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d09fbc80-adeb-40cb-abed-2d1493b81aff tempest-CinderUnicodeTest-2118930680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598" returned: 0 in 0.793s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d09fbc80-adeb-40cb-abed-2d1493b81aff tempest-CinderUnicodeTest-2118930680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:05 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598 Jul 03 01:22:05 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:05 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6f1fd26c-fef5-4f04-a839-7cc24ed5e5d6 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.info" returned: 0 in 0.710s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6f1fd26c-fef5-4f04-a839-7cc24ed5e5d6 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.302s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:22:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6f1fd26c-fef5-4f04-a839-7cc24ed5e5d6 tempest-VolumesSnapshotTestJSON-1487329281 None] Create snapshot completed successfully Jul 03 01:22:05 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d09fbc80-adeb-40cb-abed-2d1493b81aff tempest-CinderUnicodeTest-2118930680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-9b49fad5-18aa-4c99-ae1e-206d0d71c598" returned: 0 in 0.678s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d09fbc80-adeb-40cb-abed-2d1493b81aff tempest-CinderUnicodeTest-2118930680 None] Lock "cinder-quobyte-9b49fad5-18aa-4c99-ae1e-206d0d71c598" released by "delete_volume" :: held 1.533s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:05 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-d09fbc80-adeb-40cb-abed-2d1493b81aff tempest-CinderUnicodeTest-2118930680 None] Created reservations ['c583e09d-b3ba-4872-9223-8e2a9aea62a8', '2d298d71-4da4-4375-b132-f0a9217ab415', '92347ed1-ab87-4324-b87b-8474986df9bf', '7e35e921-fbf4-471a-b463-9207f97056a7'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:22:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d09fbc80-adeb-40cb-abed-2d1493b81aff tempest-CinderUnicodeTest-2118930680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:22:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d09fbc80-adeb-40cb-abed-2d1493b81aff tempest-CinderUnicodeTest-2118930680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:22:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d09fbc80-adeb-40cb-abed-2d1493b81aff tempest-CinderUnicodeTest-2118930680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:22:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d09fbc80-adeb-40cb-abed-2d1493b81aff tempest-CinderUnicodeTest-2118930680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:22:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d09fbc80-adeb-40cb-abed-2d1493b81aff tempest-CinderUnicodeTest-2118930680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:22:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d09fbc80-adeb-40cb-abed-2d1493b81aff tempest-CinderUnicodeTest-2118930680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:05 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:22:05 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ecc87be5-669d-445d-ab27-ff8bb34a601b tempest-CinderUnicodeTest-2118930680 None] Acquiring lock "cinder-7320b7c2-fc41-4bab-9936-f3b235b781a6-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:22:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ecc87be5-669d-445d-ab27-ff8bb34a601b tempest-CinderUnicodeTest-2118930680 None] Lock "cinder-7320b7c2-fc41-4bab-9936-f3b235b781a6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:22:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ecc87be5-669d-445d-ab27-ff8bb34a601b tempest-CinderUnicodeTest-2118930680 None] Acquiring lock "cinder-quobyte-7320b7c2-fc41-4bab-9936-f3b235b781a6" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:22:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ecc87be5-669d-445d-ab27-ff8bb34a601b tempest-CinderUnicodeTest-2118930680 None] Lock "cinder-quobyte-7320b7c2-fc41-4bab-9936-f3b235b781a6" acquired by "delete_volume" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:22:06 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d09fbc80-adeb-40cb-abed-2d1493b81aff tempest-CinderUnicodeTest-2118930680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.712s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:06 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-d09fbc80-adeb-40cb-abed-2d1493b81aff tempest-CinderUnicodeTest-2118930680 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:22:06 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d09fbc80-adeb-40cb-abed-2d1493b81aff tempest-CinderUnicodeTest-2118930680 None] Deleted volume successfully. Jul 03 01:22:06 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f4a1b4-9d70-4947-94d5-7ccab7a6a568]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:22:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ecc87be5-669d-445d-ab27-ff8bb34a601b tempest-CinderUnicodeTest-2118930680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7320b7c2-fc41-4bab-9936-f3b235b781a6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d09fbc80-adeb-40cb-abed-2d1493b81aff tempest-CinderUnicodeTest-2118930680 None] Lock "cinder-9b49fad5-18aa-4c99-ae1e-206d0d71c598-delete_volume" released by "delete_volume" :: held 2.456s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:06 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7320b7c2-fc41-4bab-9936-f3b235b781a6 Jul 03 01:22:06 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Flow 'volume_create_manager' (71fdf276-36a0-4edf-9a7f-956c46a87ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d599ed79-8186-4afd-934a-b6ebcce42c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d599ed79-8186-4afd-934a-b6ebcce42c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-379006090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11b6dbc-f864-4737-88d4-8e1154d761df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d26f56b8034d6d962d96784784199e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=51ad580a-9a9e-4eec-9f7a-605d95a0e881,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:22:07Z,use_quota=True,user_id='3ca48520154f47179f254f3272ab50e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c823f7d-aad4-4dfe-9a8a-afd8963fea27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c823f7d-aad4-4dfe-9a8a-afd8963fea27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cafc4d4-55d6-4bd1-8754-6f49ae0d5b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cafc4d4-55d6-4bd1-8754-6f49ae0d5b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c11b6dbc-f864-4737-88d4-8e1154d761df', 'volume_name': 'volume-c11b6dbc-f864-4737-88d4-8e1154d761df', 'volume_size': 1, 'snapshot_id': '51ad580a-9a9e-4eec-9f7a-605d95a0e881'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c8b719-653e-4c02-b5ad-b6968ce17006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c8b719-653e-4c02-b5ad-b6968ce17006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a253a414-b33a-4465-b3ec-308b1f5efd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:22:07 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Volume c11b6dbc-f864-4737-88d4-8e1154d761df: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c11b6dbc-f864-4737-88d4-8e1154d761df', 'volume_size': 1, 'snapshot_id': '51ad580a-9a9e-4eec-9f7a-605d95a0e881'} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "cinder-quobyte-51ad580a-9a9e-4eec-9f7a-605d95a0e881-c11b6dbc-f864-4737-88d4-8e1154d761df" by "_create_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-51ad580a-9a9e-4eec-9f7a-605d95a0e881-c11b6dbc-f864-4737-88d4-8e1154d761df" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Creating volume c11b6dbc-f864-4737-88d4-8e1154d761df from snapshot 51ad580a-9a9e-4eec-9f7a-605d95a0e881 {{(pid=86772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "cinder-quobyte-c11b6dbc-f864-4737-88d4-8e1154d761df" by "_copy_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-c11b6dbc-f864-4737-88d4-8e1154d761df" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] snapshot: 51ad580a-9a9e-4eec-9f7a-605d95a0e881, volume: c11b6dbc-f864-4737-88d4-8e1154d761df, {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0fceff-3a1a-4fca-93a3-69eaa2b2d8d2]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.51ad580a-9a9e-4eec-9f7a-605d95a0e881 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:07 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:07 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.51ad580a-9a9e-4eec-9f7a-605d95a0e881 Jul 03 01:22:07 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ecc87be5-669d-445d-ab27-ff8bb34a601b tempest-CinderUnicodeTest-2118930680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7320b7c2-fc41-4bab-9936-f3b235b781a6" returned: 0 in 0.831s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ecc87be5-669d-445d-ab27-ff8bb34a601b tempest-CinderUnicodeTest-2118930680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7320b7c2-fc41-4bab-9936-f3b235b781a6 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:07 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7320b7c2-fc41-4bab-9936-f3b235b781a6 Jul 03 01:22:07 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:08 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.51ad580a-9a9e-4eec-9f7a-605d95a0e881" returned: 0 in 0.811s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3eef0442-2908-4309-b9df-86f7f4d470b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:22:08 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7 {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 01:22:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Creating direct copy from snapshot {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 01:22:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ecc87be5-669d-445d-ab27-ff8bb34a601b tempest-CinderUnicodeTest-2118930680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7320b7c2-fc41-4bab-9936-f3b235b781a6" returned: 0 in 0.694s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:08 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e3234a-f161-4c83-995d-7653e7bd11b1]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:22:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ecc87be5-669d-445d-ab27-ff8bb34a601b tempest-CinderUnicodeTest-2118930680 None] Lock "cinder-quobyte-7320b7c2-fc41-4bab-9936-f3b235b781a6" released by "delete_volume" :: held 1.591s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:08 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-ecc87be5-669d-445d-ab27-ff8bb34a601b tempest-CinderUnicodeTest-2118930680 None] Created reservations ['edcca85b-86c6-46c0-99de-95a29e1ff51d', '331ca2ab-4dd5-4fbf-a545-3616db1ebe9b', '72aa51f4-c872-4787-b3ed-6fd721b178fa', '5f8b658d-ba75-4879-97f5-91c20ac62ecd'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:22:08 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7 Jul 03 01:22:08 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ecc87be5-669d-445d-ab27-ff8bb34a601b tempest-CinderUnicodeTest-2118930680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:22:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ecc87be5-669d-445d-ab27-ff8bb34a601b tempest-CinderUnicodeTest-2118930680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:22:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ecc87be5-669d-445d-ab27-ff8bb34a601b tempest-CinderUnicodeTest-2118930680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:22:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ecc87be5-669d-445d-ab27-ff8bb34a601b tempest-CinderUnicodeTest-2118930680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:22:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ecc87be5-669d-445d-ab27-ff8bb34a601b tempest-CinderUnicodeTest-2118930680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:22:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ecc87be5-669d-445d-ab27-ff8bb34a601b tempest-CinderUnicodeTest-2118930680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:08 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:22:08 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:09 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ecc87be5-669d-445d-ab27-ff8bb34a601b tempest-CinderUnicodeTest-2118930680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.722s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:09 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-ecc87be5-669d-445d-ab27-ff8bb34a601b tempest-CinderUnicodeTest-2118930680 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:22:09 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ecc87be5-669d-445d-ab27-ff8bb34a601b tempest-CinderUnicodeTest-2118930680 None] Deleted volume successfully. Jul 03 01:22:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ecc87be5-669d-445d-ab27-ff8bb34a601b tempest-CinderUnicodeTest-2118930680 None] Lock "cinder-7320b7c2-fc41-4bab-9936-f3b235b781a6-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:09 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7" returned: 0 in 0.918s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:09 devstack cinder-volume[86772]: DEBUG cinder.utils [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Path /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c11b6dbc-f864-4737-88d4-8e1154d761df not found in is_blk_device check {{(pid=86772) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 01:22:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c11b6dbc-f864-4737-88d4-8e1154d761df {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:09 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c11b6dbc-f864-4737-88d4-8e1154d761df Jul 03 01:22:09 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:22:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:22:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:22:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:22:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:22:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:22:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:12 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:22:12 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:14 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.481s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:14 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:22:14 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:22:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 29 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:22:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:22:14 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c11b6dbc-f864-4737-88d4-8e1154d761df" returned: 0 in 5.577s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:14 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cc3f12-e3c7-490d-a747-f066dcde3224]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:22:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:14 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7 Jul 03 01:22:14 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:15 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7" returned: 0 in 1.036s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:15 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Image conversion details: src /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7, size 1024.00 MB, duration 5.58 sec, destination /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c11b6dbc-f864-4737-88d4-8e1154d761df {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:22:15 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Converted 1024.00 MB image at 183.57 MB/s Jul 03 01:22:15 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c11b6dbc-f864-4737-88d4-8e1154d761df is being set with open permissions: ugo+rw Jul 03 01:22:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c11b6dbc-f864-4737-88d4-8e1154d761df {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:15 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c11b6dbc-f864-4737-88d4-8e1154d761df Jul 03 01:22:15 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:16 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c11b6dbc-f864-4737-88d4-8e1154d761df" returned: 0 in 0.707s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-c11b6dbc-f864-4737-88d4-8e1154d761df" released by "_copy_volume_from_snapshot" :: held 9.151s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-51ad580a-9a9e-4eec-9f7a-605d95a0e881-c11b6dbc-f864-4737-88d4-8e1154d761df" released by "_create_volume_from_snapshot" :: held 9.186s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.204s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:22:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a253a414-b33a-4465-b3ec-308b1f5efd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c11b6dbc-f864-4737-88d4-8e1154d761df', 'volume_size': 1, 'snapshot_id': '51ad580a-9a9e-4eec-9f7a-605d95a0e881'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:22:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e058c6-3f29-4887-8e97-3923a56b0505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:22:16 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Volume volume-c11b6dbc-f864-4737-88d4-8e1154d761df (c11b6dbc-f864-4737-88d4-8e1154d761df): created successfully Jul 03 01:22:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e058c6-3f29-4887-8e97-3923a56b0505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:22:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Flow 'volume_create_manager' (71fdf276-36a0-4edf-9a7f-956c46a87ba5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:22:16 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f3af4491-139b-468f-b9b6-986a745648d5 tempest-VolumesSnapshotTestJSON-1487329281 None] Created volume successfully. Jul 03 01:22:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-94017232-da9f-4c3f-9446-32030019a419 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "cinder-c11b6dbc-f864-4737-88d4-8e1154d761df-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:22:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-94017232-da9f-4c3f-9446-32030019a419 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-c11b6dbc-f864-4737-88d4-8e1154d761df-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:22:17 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=102,cinder:SELECT=83,cinder:INSERT=23,cinder:DELETE=8 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:22:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-94017232-da9f-4c3f-9446-32030019a419 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "cinder-quobyte-c11b6dbc-f864-4737-88d4-8e1154d761df" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:22:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-94017232-da9f-4c3f-9446-32030019a419 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-c11b6dbc-f864-4737-88d4-8e1154d761df" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:22:17 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bab63d-2a9b-48a6-87fa-a30d8ba719c9]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:22:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-94017232-da9f-4c3f-9446-32030019a419 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c11b6dbc-f864-4737-88d4-8e1154d761df {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:17 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c11b6dbc-f864-4737-88d4-8e1154d761df Jul 03 01:22:17 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:18 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-94017232-da9f-4c3f-9446-32030019a419 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c11b6dbc-f864-4737-88d4-8e1154d761df" returned: 0 in 0.884s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-94017232-da9f-4c3f-9446-32030019a419 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c11b6dbc-f864-4737-88d4-8e1154d761df {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:18 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c11b6dbc-f864-4737-88d4-8e1154d761df Jul 03 01:22:18 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:18 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-94017232-da9f-4c3f-9446-32030019a419 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c11b6dbc-f864-4737-88d4-8e1154d761df" returned: 0 in 0.702s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-94017232-da9f-4c3f-9446-32030019a419 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-c11b6dbc-f864-4737-88d4-8e1154d761df" released by "delete_volume" :: held 1.630s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:19 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:DELETE=9,cinder:SELECT=87,cinder:UPDATE=71,cinder:INSERT=28 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:22:19 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-94017232-da9f-4c3f-9446-32030019a419 tempest-VolumesSnapshotTestJSON-1487329281 None] Created reservations ['4e418afe-86c4-4ac8-95fb-8c6a01d4b9f9', 'cc23717a-302a-4e8d-ab9c-aab816fc8d50', 'a742acf8-b7a2-4d94-aac6-9e64b0e43004', '95c205ce-d944-427d-9541-cd27efaf2e10'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:22:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-94017232-da9f-4c3f-9446-32030019a419 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:22:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-94017232-da9f-4c3f-9446-32030019a419 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:22:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-94017232-da9f-4c3f-9446-32030019a419 tempest-VolumesSnapshotTestJSON-1487329281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:22:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-94017232-da9f-4c3f-9446-32030019a419 tempest-VolumesSnapshotTestJSON-1487329281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:22:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-94017232-da9f-4c3f-9446-32030019a419 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:22:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-94017232-da9f-4c3f-9446-32030019a419 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:19 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:22:19 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4174f134-9c18-4dec-842b-138fb9f4b762 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "cinder-51ad580a-9a9e-4eec-9f7a-605d95a0e881-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:22:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4174f134-9c18-4dec-842b-138fb9f4b762 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-51ad580a-9a9e-4eec-9f7a-605d95a0e881-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:22:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4174f134-9c18-4dec-842b-138fb9f4b762 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "cinder-quobyte-3eef0442-2908-4309-b9df-86f7f4d470b7" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:22:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4174f134-9c18-4dec-842b-138fb9f4b762 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-3eef0442-2908-4309-b9df-86f7f4d470b7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:22:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4174f134-9c18-4dec-842b-138fb9f4b762 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "cinder-quobyte-51ad580a-9a9e-4eec-9f7a-605d95a0e881" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:22:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4174f134-9c18-4dec-842b-138fb9f4b762 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-51ad580a-9a9e-4eec-9f7a-605d95a0e881" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:22:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4174f134-9c18-4dec-842b-138fb9f4b762 tempest-VolumesSnapshotTestJSON-1487329281 None] Deleting offline snapshot 51ad580a-9a9e-4eec-9f7a-605d95a0e881 of volume 3eef0442-2908-4309-b9df-86f7f4d470b7 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:22:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4174f134-9c18-4dec-842b-138fb9f4b762 tempest-VolumesSnapshotTestJSON-1487329281 None] snapshot_file for this snap is: volume-3eef0442-2908-4309-b9df-86f7f4d470b7.51ad580a-9a9e-4eec-9f7a-605d95a0e881 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:22:19 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07f6876-8f4a-4c4c-9b12-ca61f05668d5]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:22:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4174f134-9c18-4dec-842b-138fb9f4b762 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.51ad580a-9a9e-4eec-9f7a-605d95a0e881 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:19 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.51ad580a-9a9e-4eec-9f7a-605d95a0e881 Jul 03 01:22:19 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:19 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-94017232-da9f-4c3f-9446-32030019a419 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.651s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:19 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-94017232-da9f-4c3f-9446-32030019a419 tempest-VolumesSnapshotTestJSON-1487329281 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:22:19 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-94017232-da9f-4c3f-9446-32030019a419 tempest-VolumesSnapshotTestJSON-1487329281 None] Deleted volume successfully. Jul 03 01:22:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-94017232-da9f-4c3f-9446-32030019a419 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-c11b6dbc-f864-4737-88d4-8e1154d761df-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:20 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4174f134-9c18-4dec-842b-138fb9f4b762 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.51ad580a-9a9e-4eec-9f7a-605d95a0e881" returned: 0 in 0.730s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4174f134-9c18-4dec-842b-138fb9f4b762 tempest-VolumesSnapshotTestJSON-1487329281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3eef0442-2908-4309-b9df-86f7f4d470b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:22:20 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[146c1ec7-e92b-4276-8c24-12f72dfca433]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:22:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4174f134-9c18-4dec-842b-138fb9f4b762 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:20 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7 Jul 03 01:22:20 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:21 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4174f134-9c18-4dec-842b-138fb9f4b762 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7" returned: 0 in 0.755s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4174f134-9c18-4dec-842b-138fb9f4b762 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.51ad580a-9a9e-4eec-9f7a-605d95a0e881 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:21 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.51ad580a-9a9e-4eec-9f7a-605d95a0e881 Jul 03 01:22:21 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:21 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4174f134-9c18-4dec-842b-138fb9f4b762 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.51ad580a-9a9e-4eec-9f7a-605d95a0e881" returned: 0 in 0.765s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4174f134-9c18-4dec-842b-138fb9f4b762 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.51ad580a-9a9e-4eec-9f7a-605d95a0e881 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:21 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.51ad580a-9a9e-4eec-9f7a-605d95a0e881 Jul 03 01:22:21 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:22 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4174f134-9c18-4dec-842b-138fb9f4b762 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7.51ad580a-9a9e-4eec-9f7a-605d95a0e881" returned: 0 in 0.622s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4174f134-9c18-4dec-842b-138fb9f4b762 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-51ad580a-9a9e-4eec-9f7a-605d95a0e881" released by "_delete_snapshot" :: held 2.968s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4174f134-9c18-4dec-842b-138fb9f4b762 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-3eef0442-2908-4309-b9df-86f7f4d470b7" released by "delete_snapshot" :: held 2.994s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:22 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-4174f134-9c18-4dec-842b-138fb9f4b762 tempest-VolumesSnapshotTestJSON-1487329281 None] Created reservations ['a6911654-8e65-4145-be61-f35e41239545', 'b03643cc-006c-497e-8bc3-849c7d705515', 'b28af15c-ba78-48be-8112-0fcb2aaf014a', 'f2eec3fd-4b7f-4178-81c4-151f8326f2b3'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:22:22 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4174f134-9c18-4dec-842b-138fb9f4b762 tempest-VolumesSnapshotTestJSON-1487329281 None] Delete snapshot completed successfully. Jul 03 01:22:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4174f134-9c18-4dec-842b-138fb9f4b762 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-51ad580a-9a9e-4eec-9f7a-605d95a0e881-delete_snapshot" released by "delete_snapshot" :: held 3.154s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-05bf74bb-9c7d-4ce6-a63a-dd9801c65da4 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "cinder-3eef0442-2908-4309-b9df-86f7f4d470b7-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:22:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-05bf74bb-9c7d-4ce6-a63a-dd9801c65da4 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-3eef0442-2908-4309-b9df-86f7f4d470b7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:22:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-05bf74bb-9c7d-4ce6-a63a-dd9801c65da4 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "cinder-quobyte-3eef0442-2908-4309-b9df-86f7f4d470b7" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:22:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-05bf74bb-9c7d-4ce6-a63a-dd9801c65da4 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-3eef0442-2908-4309-b9df-86f7f4d470b7" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:22:22 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[521382c0-f7ac-4589-8702-5fef024870ca]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:22:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05bf74bb-9c7d-4ce6-a63a-dd9801c65da4 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:23 devstack sudo[104877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7 Jul 03 01:22:23 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:23 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05bf74bb-9c7d-4ce6-a63a-dd9801c65da4 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7" returned: 0 in 0.756s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05bf74bb-9c7d-4ce6-a63a-dd9801c65da4 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:23 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7 Jul 03 01:22:23 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:24 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05bf74bb-9c7d-4ce6-a63a-dd9801c65da4 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-3eef0442-2908-4309-b9df-86f7f4d470b7" returned: 0 in 0.628s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-05bf74bb-9c7d-4ce6-a63a-dd9801c65da4 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-3eef0442-2908-4309-b9df-86f7f4d470b7" released by "delete_volume" :: held 1.444s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:24 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-05bf74bb-9c7d-4ce6-a63a-dd9801c65da4 tempest-VolumesSnapshotTestJSON-1487329281 None] Created reservations ['b84868fc-9596-4148-83fe-fd14437d58d2', '53640e96-9030-480b-a2e4-d459da411025', '6a864892-0416-41ae-9a45-a7818eaab8ed', '596c6210-dc73-4d6a-9fd0-579c75bef0bd'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:22:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-05bf74bb-9c7d-4ce6-a63a-dd9801c65da4 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:22:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-05bf74bb-9c7d-4ce6-a63a-dd9801c65da4 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:22:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-05bf74bb-9c7d-4ce6-a63a-dd9801c65da4 tempest-VolumesSnapshotTestJSON-1487329281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:22:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-05bf74bb-9c7d-4ce6-a63a-dd9801c65da4 tempest-VolumesSnapshotTestJSON-1487329281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:22:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-05bf74bb-9c7d-4ce6-a63a-dd9801c65da4 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:22:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05bf74bb-9c7d-4ce6-a63a-dd9801c65da4 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:24 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:22:24 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:25 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05bf74bb-9c7d-4ce6-a63a-dd9801c65da4 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.627s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:25 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-05bf74bb-9c7d-4ce6-a63a-dd9801c65da4 tempest-VolumesSnapshotTestJSON-1487329281 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:22:25 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-05bf74bb-9c7d-4ce6-a63a-dd9801c65da4 tempest-VolumesSnapshotTestJSON-1487329281 None] Deleted volume successfully. Jul 03 01:22:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7bfd1326-9671-468d-b1fa-3b0a0e326f02 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "cinder-5747c227-a22e-4723-a7dd-386db9cf8336-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:22:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7bfd1326-9671-468d-b1fa-3b0a0e326f02 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-5747c227-a22e-4723-a7dd-386db9cf8336-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:22:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-05bf74bb-9c7d-4ce6-a63a-dd9801c65da4 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-3eef0442-2908-4309-b9df-86f7f4d470b7-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7bfd1326-9671-468d-b1fa-3b0a0e326f02 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "cinder-quobyte-5747c227-a22e-4723-a7dd-386db9cf8336" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:22:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7bfd1326-9671-468d-b1fa-3b0a0e326f02 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-5747c227-a22e-4723-a7dd-386db9cf8336" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:22:25 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e7f110-f3d3-4c5d-b7ed-a6db98443ce1]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:22:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7bfd1326-9671-468d-b1fa-3b0a0e326f02 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:25 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336 Jul 03 01:22:25 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:26 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7bfd1326-9671-468d-b1fa-3b0a0e326f02 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336" returned: 0 in 0.777s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7bfd1326-9671-468d-b1fa-3b0a0e326f02 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:26 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336 Jul 03 01:22:26 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:26 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7bfd1326-9671-468d-b1fa-3b0a0e326f02 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5747c227-a22e-4723-a7dd-386db9cf8336" returned: 0 in 0.651s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7bfd1326-9671-468d-b1fa-3b0a0e326f02 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-quobyte-5747c227-a22e-4723-a7dd-386db9cf8336" released by "delete_volume" :: held 1.486s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:26 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-7bfd1326-9671-468d-b1fa-3b0a0e326f02 tempest-VolumesSnapshotTestJSON-1487329281 None] Created reservations ['062319a0-12f5-4e54-8dc4-53b718d8fa13', '01646e43-8ae6-4fb5-9d9d-385cb936b86c', '9ce444d5-044b-4855-9ec8-5fc24177e56d', '673a216f-b651-48cb-bafb-27caef0985a9'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:22:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7bfd1326-9671-468d-b1fa-3b0a0e326f02 tempest-VolumesSnapshotTestJSON-1487329281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:22:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7bfd1326-9671-468d-b1fa-3b0a0e326f02 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:22:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7bfd1326-9671-468d-b1fa-3b0a0e326f02 tempest-VolumesSnapshotTestJSON-1487329281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:22:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7bfd1326-9671-468d-b1fa-3b0a0e326f02 tempest-VolumesSnapshotTestJSON-1487329281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:22:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7bfd1326-9671-468d-b1fa-3b0a0e326f02 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:22:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7bfd1326-9671-468d-b1fa-3b0a0e326f02 tempest-VolumesSnapshotTestJSON-1487329281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:26 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:22:26 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:27 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7bfd1326-9671-468d-b1fa-3b0a0e326f02 tempest-VolumesSnapshotTestJSON-1487329281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.637s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:27 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-7bfd1326-9671-468d-b1fa-3b0a0e326f02 tempest-VolumesSnapshotTestJSON-1487329281 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:22:27 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7bfd1326-9671-468d-b1fa-3b0a0e326f02 tempest-VolumesSnapshotTestJSON-1487329281 None] Deleted volume successfully. Jul 03 01:22:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7bfd1326-9671-468d-b1fa-3b0a0e326f02 tempest-VolumesSnapshotTestJSON-1487329281 None] Lock "cinder-5747c227-a22e-4723-a7dd-386db9cf8336-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:33 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:22:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Flow 'volume_create_manager' (b769c928-baab-4b17-b467-cfeb082ad98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:22:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14f5119-7ef3-41c1-a472-6811fc264efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:22:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14f5119-7ef3-41c1-a472-6811fc264efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1107850764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0302007e-7524-43cc-afcf-aeae0b01e2de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6763d2f5844eaba54b8c7f3b06958a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:22:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:22:34Z,use_quota=True,user_id='fa08d66af437440c95305c5cf05dceee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:22:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90ddbc0-6f54-4136-a9bd-8bb902a39280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:22:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90ddbc0-6f54-4136-a9bd-8bb902a39280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:22:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d7e36c8-5d4f-4c8f-b1a9-ac3e044dcfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:22:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d7e36c8-5d4f-4c8f-b1a9-ac3e044dcfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0302007e-7524-43cc-afcf-aeae0b01e2de', 'volume_name': 'volume-0302007e-7524-43cc-afcf-aeae0b01e2de', 'volume_size': 2}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:22:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a02df8-87af-40c0-bbdc-eb6af0a8ed55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:22:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a02df8-87af-40c0-bbdc-eb6af0a8ed55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:22:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8785fb5c-fb2d-445a-9b12-4a8368f15056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:22:33 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Volume 0302007e-7524-43cc-afcf-aeae0b01e2de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0302007e-7524-43cc-afcf-aeae0b01e2de', 'volume_size': 2} Jul 03 01:22:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:22:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:22:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1107850764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0302007e-7524-43cc-afcf-aeae0b01e2de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6763d2f5844eaba54b8c7f3b06958a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:22:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:22:34Z,use_quota=True,user_id='fa08d66af437440c95305c5cf05dceee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:22:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Creating volume 0302007e-7524-43cc-afcf-aeae0b01e2de {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:22:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:22:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:22:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:22:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:22:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:22:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:22:33 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:22:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de 2147483648 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:33 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de 2147483648 Jul 03 01:22:33 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:34 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de 2147483648" returned: 0 in 0.899s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:34 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de Jul 03 01:22:34 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:35 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de" returned: 0 in 0.619s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:22:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:22:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8785fb5c-fb2d-445a-9b12-4a8368f15056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0302007e-7524-43cc-afcf-aeae0b01e2de', 'volume_size': 2}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:22:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62192f1e-3411-4f59-bb69-74ba18b8f442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:22:35 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Volume volume-0302007e-7524-43cc-afcf-aeae0b01e2de (0302007e-7524-43cc-afcf-aeae0b01e2de): created successfully Jul 03 01:22:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62192f1e-3411-4f59-bb69-74ba18b8f442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:22:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Flow 'volume_create_manager' (b769c928-baab-4b17-b467-cfeb082ad98b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:22:35 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7b6dc27b-29bb-4c63-a20f-aa9d77e18213 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Created volume successfully. Jul 03 01:22:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8b695abd-d018-4ce6-815c-e1ef95c391d1 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:22:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8b695abd-d018-4ce6-815c-e1ef95c391d1 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:22:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-8b695abd-d018-4ce6-815c-e1ef95c391d1 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Creating offline snapshot 5e0c5c76-334b-42f1-96ac-5480da0d590f of volume 0302007e-7524-43cc-afcf-aeae0b01e2de {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:22:35 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6842301b-ae27-4839-b12f-f3a979b7e3f2]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:22:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b695abd-d018-4ce6-815c-e1ef95c391d1 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:36 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de Jul 03 01:22:36 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:36 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b695abd-d018-4ce6-815c-e1ef95c391d1 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de" returned: 0 in 0.805s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b695abd-d018-4ce6-815c-e1ef95c391d1 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de.5e0c5c76-334b-42f1-96ac-5480da0d590f 2G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:36 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de.5e0c5c76-334b-42f1-96ac-5480da0d590f 2G Jul 03 01:22:36 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:37 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b695abd-d018-4ce6-815c-e1ef95c391d1 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de.5e0c5c76-334b-42f1-96ac-5480da0d590f 2G" returned: 0 in 0.808s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b695abd-d018-4ce6-815c-e1ef95c391d1 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0302007e-7524-43cc-afcf-aeae0b01e2de -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de.5e0c5c76-334b-42f1-96ac-5480da0d590f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:37 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0302007e-7524-43cc-afcf-aeae0b01e2de -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de.5e0c5c76-334b-42f1-96ac-5480da0d590f Jul 03 01:22:37 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:38 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b695abd-d018-4ce6-815c-e1ef95c391d1 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0302007e-7524-43cc-afcf-aeae0b01e2de -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de.5e0c5c76-334b-42f1-96ac-5480da0d590f" returned: 0 in 0.755s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:38 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-8b695abd-d018-4ce6-815c-e1ef95c391d1 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de.5e0c5c76-334b-42f1-96ac-5480da0d590f is being set with open permissions: ugo+rw Jul 03 01:22:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b695abd-d018-4ce6-815c-e1ef95c391d1 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de.5e0c5c76-334b-42f1-96ac-5480da0d590f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:38 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de.5e0c5c76-334b-42f1-96ac-5480da0d590f Jul 03 01:22:38 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:38 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b695abd-d018-4ce6-815c-e1ef95c391d1 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de.5e0c5c76-334b-42f1-96ac-5480da0d590f" returned: 0 in 0.638s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b695abd-d018-4ce6-815c-e1ef95c391d1 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:38 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de.info Jul 03 01:22:38 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:39 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b695abd-d018-4ce6-815c-e1ef95c391d1 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de.info" returned: 0 in 0.722s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:39 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-8b695abd-d018-4ce6-815c-e1ef95c391d1 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de.info is being set with open permissions: ugo+rw Jul 03 01:22:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b695abd-d018-4ce6-815c-e1ef95c391d1 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:39 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de.info Jul 03 01:22:39 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:40 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b695abd-d018-4ce6-815c-e1ef95c391d1 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de.info" returned: 0 in 0.624s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8b695abd-d018-4ce6-815c-e1ef95c391d1 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.442s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:22:40 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8b695abd-d018-4ce6-815c-e1ef95c391d1 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Create snapshot completed successfully Jul 03 01:22:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f67777d3-4576-45db-9d0f-e13903b75670 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Acquiring lock "cinder-5e0c5c76-334b-42f1-96ac-5480da0d590f-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:22:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f67777d3-4576-45db-9d0f-e13903b75670 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Lock "cinder-5e0c5c76-334b-42f1-96ac-5480da0d590f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:22:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f67777d3-4576-45db-9d0f-e13903b75670 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Acquiring lock "cinder-quobyte-0302007e-7524-43cc-afcf-aeae0b01e2de" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:22:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f67777d3-4576-45db-9d0f-e13903b75670 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Lock "cinder-quobyte-0302007e-7524-43cc-afcf-aeae0b01e2de" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:22:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f67777d3-4576-45db-9d0f-e13903b75670 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Acquiring lock "cinder-quobyte-5e0c5c76-334b-42f1-96ac-5480da0d590f" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:22:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f67777d3-4576-45db-9d0f-e13903b75670 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Lock "cinder-quobyte-5e0c5c76-334b-42f1-96ac-5480da0d590f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:22:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f67777d3-4576-45db-9d0f-e13903b75670 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Deleting offline snapshot 5e0c5c76-334b-42f1-96ac-5480da0d590f of volume 0302007e-7524-43cc-afcf-aeae0b01e2de {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:22:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f67777d3-4576-45db-9d0f-e13903b75670 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] snapshot_file for this snap is: volume-0302007e-7524-43cc-afcf-aeae0b01e2de.5e0c5c76-334b-42f1-96ac-5480da0d590f {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:22:41 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc151a54-61ce-4e6b-b560-629df935899d]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:22:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f67777d3-4576-45db-9d0f-e13903b75670 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de.5e0c5c76-334b-42f1-96ac-5480da0d590f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:41 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de.5e0c5c76-334b-42f1-96ac-5480da0d590f Jul 03 01:22:41 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:42 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f67777d3-4576-45db-9d0f-e13903b75670 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de.5e0c5c76-334b-42f1-96ac-5480da0d590f" returned: 0 in 0.794s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f67777d3-4576-45db-9d0f-e13903b75670 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0302007e-7524-43cc-afcf-aeae0b01e2de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:22:42 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[333fade6-cc5c-4277-aaad-41b15931a22c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:22:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f67777d3-4576-45db-9d0f-e13903b75670 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:42 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de Jul 03 01:22:42 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:42 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f67777d3-4576-45db-9d0f-e13903b75670 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de" returned: 0 in 0.770s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f67777d3-4576-45db-9d0f-e13903b75670 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de.5e0c5c76-334b-42f1-96ac-5480da0d590f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:42 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de.5e0c5c76-334b-42f1-96ac-5480da0d590f Jul 03 01:22:42 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:43 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f67777d3-4576-45db-9d0f-e13903b75670 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de.5e0c5c76-334b-42f1-96ac-5480da0d590f" returned: 0 in 0.743s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f67777d3-4576-45db-9d0f-e13903b75670 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de.5e0c5c76-334b-42f1-96ac-5480da0d590f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:43 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de.5e0c5c76-334b-42f1-96ac-5480da0d590f Jul 03 01:22:43 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:44 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f67777d3-4576-45db-9d0f-e13903b75670 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de.5e0c5c76-334b-42f1-96ac-5480da0d590f" returned: 0 in 0.696s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f67777d3-4576-45db-9d0f-e13903b75670 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Lock "cinder-quobyte-5e0c5c76-334b-42f1-96ac-5480da0d590f" released by "_delete_snapshot" :: held 3.102s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f67777d3-4576-45db-9d0f-e13903b75670 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Lock "cinder-quobyte-0302007e-7524-43cc-afcf-aeae0b01e2de" released by "delete_snapshot" :: held 3.125s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:44 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-f67777d3-4576-45db-9d0f-e13903b75670 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Created reservations ['4ec6a16e-34a3-4070-9658-316dc48275ed', 'a0fc4744-83fe-42f8-a2fd-0fbb8390c411', '5adcb277-9431-40b0-91f7-400705cfe06a', '8fb317ae-1c87-46fa-ab7b-8a4a7b269df0'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:22:44 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f67777d3-4576-45db-9d0f-e13903b75670 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Delete snapshot completed successfully. Jul 03 01:22:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f67777d3-4576-45db-9d0f-e13903b75670 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Lock "cinder-5e0c5c76-334b-42f1-96ac-5480da0d590f-delete_snapshot" released by "delete_snapshot" :: held 3.265s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d0301cf5-3b10-4d0b-8de3-c7695299fef4 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Acquiring lock "cinder-0302007e-7524-43cc-afcf-aeae0b01e2de-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:22:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d0301cf5-3b10-4d0b-8de3-c7695299fef4 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Lock "cinder-0302007e-7524-43cc-afcf-aeae0b01e2de-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:22:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d0301cf5-3b10-4d0b-8de3-c7695299fef4 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Acquiring lock "cinder-quobyte-0302007e-7524-43cc-afcf-aeae0b01e2de" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:22:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d0301cf5-3b10-4d0b-8de3-c7695299fef4 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Lock "cinder-quobyte-0302007e-7524-43cc-afcf-aeae0b01e2de" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:22:45 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7522915e-2673-4607-b266-c8c672e421af]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:22:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d0301cf5-3b10-4d0b-8de3-c7695299fef4 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:45 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de Jul 03 01:22:45 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:46 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d0301cf5-3b10-4d0b-8de3-c7695299fef4 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de" returned: 0 in 0.772s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d0301cf5-3b10-4d0b-8de3-c7695299fef4 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:46 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de Jul 03 01:22:46 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:47 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d0301cf5-3b10-4d0b-8de3-c7695299fef4 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-0302007e-7524-43cc-afcf-aeae0b01e2de" returned: 0 in 0.672s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d0301cf5-3b10-4d0b-8de3-c7695299fef4 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Lock "cinder-quobyte-0302007e-7524-43cc-afcf-aeae0b01e2de" released by "delete_volume" :: held 1.505s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:47 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-d0301cf5-3b10-4d0b-8de3-c7695299fef4 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Created reservations ['f6fed7bb-536a-4e99-bafb-d293e30169ae', '4fc34e4f-92a0-4552-819b-922ca75a00ca', 'f2000948-a15b-4f86-8911-88f31913ae00', 'bdc4877f-c3c8-45ce-9b8d-70a1b1ed81bf'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:22:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d0301cf5-3b10-4d0b-8de3-c7695299fef4 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:22:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d0301cf5-3b10-4d0b-8de3-c7695299fef4 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:22:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d0301cf5-3b10-4d0b-8de3-c7695299fef4 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:22:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d0301cf5-3b10-4d0b-8de3-c7695299fef4 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:22:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d0301cf5-3b10-4d0b-8de3-c7695299fef4 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:22:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d0301cf5-3b10-4d0b-8de3-c7695299fef4 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:22:47 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:22:47 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:22:47 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Jul 03 01:22:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d0301cf5-3b10-4d0b-8de3-c7695299fef4 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.707s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:22:47 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-d0301cf5-3b10-4d0b-8de3-c7695299fef4 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:22:47 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d0301cf5-3b10-4d0b-8de3-c7695299fef4 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Deleted volume successfully. Jul 03 01:22:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d0301cf5-3b10-4d0b-8de3-c7695299fef4 tempest-VolumesSnapshotNegativeTestJSON-1375412277 None] Lock "cinder-0302007e-7524-43cc-afcf-aeae0b01e2de-delete_volume" released by "delete_volume" :: held 2.405s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:22:57 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=47,cinder:SELECT=34,cinder:DELETE=4,cinder:INSERT=11 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:22:57 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=36,cinder:INSERT=15,cinder:UPDATE=47,cinder:DELETE=2 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:23:12 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:23:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Flow 'volume_create_manager' (4a7f13a8-acd4-49f7-81ad-a644cc9a52e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:23:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76d458a-1a21-4f89-bcb0-010c820f7e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76d458a-1a21-4f89-bcb0-010c820f7e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1497282089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e5d6ec2-6bdd-402e-a043-e07e8f0755d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b35662652aa245679103f6ed340d7a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:23:12Z,use_quota=True,user_id='af06b38bd14046f888b6d7a856e2984d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfeaaac3-fd90-4deb-90df-103e0fb3a68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfeaaac3-fd90-4deb-90df-103e0fb3a68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (230a0654-64bb-4cdd-a0a1-21cbb69e7ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:12 devstack cinder-volume[86772]: DEBUG cinder.image.glance [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Creating Keystone auth plugin from conf {{(pid=86772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 01:23:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (230a0654-64bb-4cdd-a0a1-21cbb69e7ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5e5d6ec2-6bdd-402e-a043-e07e8f0755d8', 'volume_name': 'volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8', 'volume_size': 1, 'image_id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d536ca8-2cba-4b44-93ed-ed247e842444', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b88b4a33269476b9f6e11e7fe82fb87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'created_at': datetime.datetime(2026, 7, 2, 22, 56, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 56, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d536ca8-2cba-4b44-93ed-ed247e842444/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d9660f-f06d-4ee5-b425-1415e2325bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d9660f-f06d-4ee5-b425-1415e2325bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f06ac5f2-e395-4595-872a-795bd65018cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:12 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Volume 5e5d6ec2-6bdd-402e-a043-e07e8f0755d8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8', 'volume_size': 1, 'image_id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d536ca8-2cba-4b44-93ed-ed247e842444', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b88b4a33269476b9f6e11e7fe82fb87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'created_at': datetime.datetime(2026, 7, 2, 22, 56, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 56, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d536ca8-2cba-4b44-93ed-ed247e842444/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 03 01:23:12 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Trying to clone 5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 from image 3d536ca8-2cba-4b44-93ed-ed247e842444 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3d536ca8-2cba-4b44-93ed-ed247e842444', 'metadata': {}}]). {{(pid=86772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 01:23:12 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_jfws1dthdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 01:23:12 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Image download 20.69 MB at 20.69 MB/s Jul 03 01:23:12 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[acaf8700-1abe-4777-9872-ed87606110a2]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:23:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_jfws1dthdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:23:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:23:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:23:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:23:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:23:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:23:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:12 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:23:12 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:12 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_jfws1dthdevstack@QuobyteHD Jul 03 01:23:12 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:13 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:13 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_jfws1dthdevstack@QuobyteHD" returned: 0 in 0.748s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:13 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Temporary image 3d536ca8-2cba-4b44-93ed-ed247e842444 is fetched for user af06b38bd14046f888b6d7a856e2984d. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 01:23:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.702s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:23:13 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:23:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 29 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:23:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:23:13 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53f866b-f863-416f-8d83-ac5a507879d0]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:23:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_jfws1dthdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:13 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_jfws1dthdevstack@QuobyteHD Jul 03 01:23:13 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:14 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_jfws1dthdevstack@QuobyteHD" returned: 0 in 0.730s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:23:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:23:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1497282089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e5d6ec2-6bdd-402e-a043-e07e8f0755d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b35662652aa245679103f6ed340d7a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:23:12Z,use_quota=True,user_id='af06b38bd14046f888b6d7a856e2984d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:23:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Creating volume 5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:23:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:23:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:23:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:23:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:23:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:23:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:23:14 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:23:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:14 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 1073741824 Jul 03 01:23:14 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:15 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 1073741824" returned: 0 in 0.789s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:15 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 Jul 03 01:23:15 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:15 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8" returned: 0 in 0.634s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:15 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:23:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:23:15 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Attempting download of 3d536ca8-2cba-4b44-93ed-ed247e842444 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d536ca8-2cba-4b44-93ed-ed247e842444', 'metadata': {}}])) to volume 5e5d6ec2-6bdd-402e-a043-e07e8f0755d8. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 01:23:15 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7c01c4-c255-4dce-8e0f-bc44edc42310]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:23:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_4yg3uy59 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:16 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_4yg3uy59 Jul 03 01:23:16 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:16 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_4yg3uy59" returned: 0 in 0.724s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_4yg3uy59 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:16 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_4yg3uy59 Jul 03 01:23:16 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:17 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_4yg3uy59" returned: 1 in 0.708s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d536ca8-2cba-4b44-93ed-ed247e842444_4yg3uy59' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:23:17 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[595d3c77-c88d-4397-9df5-af20c641afee]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:23:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_jfws1dthdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:17 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_jfws1dthdevstack@QuobyteHD Jul 03 01:23:17 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:18 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_jfws1dthdevstack@QuobyteHD" returned: 0 in 0.715s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:18 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] 3d536ca8-2cba-4b44-93ed-ed247e842444 was qcow2, converting to raw {{(pid=86772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 01:23:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_jfws1dthdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:18 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_jfws1dthdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 Jul 03 01:23:18 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:19 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_jfws1dthdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8" returned: 0 in 1.842s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:19 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3d536ca8-2cba-4b44-93ed-ed247e842444_jfws1dthdevstack@QuobyteHD, size 112.00 MB, duration 1.84 sec, destination /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:23:19 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Converted 112.00 MB image at 60.77 MB/s Jul 03 01:23:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:19 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 1G Jul 03 01:23:19 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:20 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 1G" returned: 0 in 0.731s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:20 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69e8a72-e833-4738-9417-890a552981a4]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:23:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:20 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 Jul 03 01:23:20 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:21 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8" returned: 0 in 0.768s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:21 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 Jul 03 01:23:21 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:22 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8" returned: 1 in 0.754s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:23:22 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Downloaded image 3d536ca8-2cba-4b44-93ed-ed247e842444 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d536ca8-2cba-4b44-93ed-ed247e842444', 'metadata': {}}])) to volume 5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 successfully. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 01:23:22 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Temporary image 3d536ca8-2cba-4b44-93ed-ed247e842444 for user af06b38bd14046f888b6d7a856e2984d is deleted. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 01:23:22 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Marking volume 5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 as bootable. {{(pid=86772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 01:23:22 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Copying metadata from image 3d536ca8-2cba-4b44-93ed-ed247e842444 to 5e5d6ec2-6bdd-402e-a043-e07e8f0755d8. {{(pid=86772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 01:23:22 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Creating volume glance metadata for volume 5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 backed by image 3d536ca8-2cba-4b44-93ed-ed247e842444 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 01:23:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f06ac5f2-e395-4595-872a-795bd65018cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8', 'volume_size': 1, 'image_id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d536ca8-2cba-4b44-93ed-ed247e842444', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b88b4a33269476b9f6e11e7fe82fb87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d536ca8-2cba-4b44-93ed-ed247e842444', 'created_at': datetime.datetime(2026, 7, 2, 22, 56, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 22, 56, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d536ca8-2cba-4b44-93ed-ed247e842444/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3819a6c5-f73b-49e6-8d71-abd545cf5323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:23:22 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Volume volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 (5e5d6ec2-6bdd-402e-a043-e07e8f0755d8): created successfully Jul 03 01:23:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3819a6c5-f73b-49e6-8d71-abd545cf5323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:23:22 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Flow 'volume_create_manager' (4a7f13a8-acd4-49f7-81ad-a644cc9a52e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:23:22 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-985ac9e5-a037-4644-864b-d971f4cd7bef tempest-TestShelveInstance-606039705 None] Created volume successfully. Jul 03 01:23:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-20ea482d-3da5-4df9-85b6-30ab03025a1f req-256333a6-de8c-4ea8-9c1b-c033a6ecf3c1 tempest-TestShelveInstance-606039705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:23:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-20ea482d-3da5-4df9-85b6-30ab03025a1f req-256333a6-de8c-4ea8-9c1b-c033a6ecf3c1 tempest-TestShelveInstance-606039705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:23:29 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac0fe10-2c6f-40dd-b187-602d495d90a0]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:23:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-20ea482d-3da5-4df9-85b6-30ab03025a1f req-256333a6-de8c-4ea8-9c1b-c033a6ecf3c1 tempest-TestShelveInstance-606039705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:29 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 Jul 03 01:23:29 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:30 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-20ea482d-3da5-4df9-85b6-30ab03025a1f req-256333a6-de8c-4ea8-9c1b-c033a6ecf3c1 tempest-TestShelveInstance-606039705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8" returned: 0 in 0.824s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-20ea482d-3da5-4df9-85b6-30ab03025a1f req-256333a6-de8c-4ea8-9c1b-c033a6ecf3c1 tempest-TestShelveInstance-606039705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:23:30 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 Jul 03 01:23:30 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:23:31 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Jul 03 01:23:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-20ea482d-3da5-4df9-85b6-30ab03025a1f req-256333a6-de8c-4ea8-9c1b-c033a6ecf3c1 tempest-TestShelveInstance-606039705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8" returned: 1 in 0.750s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:23:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-20ea482d-3da5-4df9-85b6-30ab03025a1f req-256333a6-de8c-4ea8-9c1b-c033a6ecf3c1 tempest-TestShelveInstance-606039705 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:23:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-20ea482d-3da5-4df9-85b6-30ab03025a1f req-256333a6-de8c-4ea8-9c1b-c033a6ecf3c1 tempest-TestShelveInstance-606039705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.621s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:23:31 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-20ea482d-3da5-4df9-85b6-30ab03025a1f req-256333a6-de8c-4ea8-9c1b-c033a6ecf3c1 tempest-TestShelveInstance-606039705 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171', 'name': 'volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '59cfe0cd-cbd8-439c-b44b-9011b91021f4', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:23:31 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-20ea482d-3da5-4df9-85b6-30ab03025a1f req-256333a6-de8c-4ea8-9c1b-c033a6ecf3c1 tempest-TestShelveInstance-606039705 None] attachment_update completed successfully. Jul 03 01:23:41 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=14,cinder:UPDATE=5,cinder:INSERT=8 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:23:41 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=16,cinder:INSERT=6,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:24:07 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:24:07 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-94d5538f-e3e4-42bc-b67e-3f80e6228f59 req-e3ebd217-97ca-4756-9a40-5c65b4b8c022 tempest-TestShelveInstance-606039705 None] Terminate volume connection completed successfully. Jul 03 01:24:07 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-94d5538f-e3e4-42bc-b67e-3f80e6228f59 req-e3ebd217-97ca-4756-9a40-5c65b4b8c022 tempest-TestShelveInstance-606039705 None] Deleting attachment 59cfe0cd-cbd8-439c-b44b-9011b91021f4. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:24:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:24:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:24:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:24:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:24:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:24:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:12 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:24:12 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-c98c9486-4317-460e-8dd2-9c59bac1d336 req-597c06ff-3f1a-4271-b8c8-28e36c3d6a65 tempest-TestShelveInstance-606039705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:24:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-c98c9486-4317-460e-8dd2-9c59bac1d336 req-597c06ff-3f1a-4271-b8c8-28e36c3d6a65 tempest-TestShelveInstance-606039705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:24:13 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[187aad21-ea9d-482a-b123-fd80d8b63362]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:24:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-c98c9486-4317-460e-8dd2-9c59bac1d336 req-597c06ff-3f1a-4271-b8c8-28e36c3d6a65 tempest-TestShelveInstance-606039705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:13 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 Jul 03 01:24:13 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:13 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.667s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:24:13 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:24:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 29 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:24:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:24:14 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-c98c9486-4317-460e-8dd2-9c59bac1d336 req-597c06ff-3f1a-4271-b8c8-28e36c3d6a65 tempest-TestShelveInstance-606039705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8" returned: 0 in 0.829s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-c98c9486-4317-460e-8dd2-9c59bac1d336 req-597c06ff-3f1a-4271-b8c8-28e36c3d6a65 tempest-TestShelveInstance-606039705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:14 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 Jul 03 01:24:14 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:14 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-c98c9486-4317-460e-8dd2-9c59bac1d336 req-597c06ff-3f1a-4271-b8c8-28e36c3d6a65 tempest-TestShelveInstance-606039705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8" returned: 1 in 0.755s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-c98c9486-4317-460e-8dd2-9c59bac1d336 req-597c06ff-3f1a-4271-b8c8-28e36c3d6a65 tempest-TestShelveInstance-606039705 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:24:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-c98c9486-4317-460e-8dd2-9c59bac1d336 req-597c06ff-3f1a-4271-b8c8-28e36c3d6a65 tempest-TestShelveInstance-606039705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.629s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-c98c9486-4317-460e-8dd2-9c59bac1d336 req-597c06ff-3f1a-4271-b8c8-28e36c3d6a65 tempest-TestShelveInstance-606039705 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171', 'name': 'volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '774c6029-4f61-4254-9c20-39e7f337c75e', 'enforce_multipath': True} {{(pid=86772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 03 01:24:15 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-c98c9486-4317-460e-8dd2-9c59bac1d336 req-597c06ff-3f1a-4271-b8c8-28e36c3d6a65 tempest-TestShelveInstance-606039705 None] attachment_update completed successfully. Jul 03 01:24:25 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:24:25 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:24:55 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-785e0c10-f9f9-403c-91d0-4e88f0e8047e req-e8a564ca-3f5a-43fe-bcb5-5f5c1d52f00a tempest-TestShelveInstance-606039705 None] Terminate volume connection completed successfully. Jul 03 01:24:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [req-785e0c10-f9f9-403c-91d0-4e88f0e8047e req-e8a564ca-3f5a-43fe-bcb5-5f5c1d52f00a tempest-TestShelveInstance-606039705 None] Deleting attachment 774c6029-4f61-4254-9c20-39e7f337c75e. {{(pid=86772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 03 01:24:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-785e0c10-f9f9-403c-91d0-4e88f0e8047e req-9662beb1-161f-4fad-a4ec-eac50efe1b37 tempest-TestShelveInstance-606039705 None] Acquiring lock "cinder-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:24:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-785e0c10-f9f9-403c-91d0-4e88f0e8047e req-9662beb1-161f-4fad-a4ec-eac50efe1b37 tempest-TestShelveInstance-606039705 None] Lock "cinder-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:24:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-785e0c10-f9f9-403c-91d0-4e88f0e8047e req-9662beb1-161f-4fad-a4ec-eac50efe1b37 tempest-TestShelveInstance-606039705 None] Acquiring lock "cinder-quobyte-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:24:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-785e0c10-f9f9-403c-91d0-4e88f0e8047e req-9662beb1-161f-4fad-a4ec-eac50efe1b37 tempest-TestShelveInstance-606039705 None] Lock "cinder-quobyte-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:24:56 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb7dc6b-3d78-4dd8-8603-0466052cb42c]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:24:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-785e0c10-f9f9-403c-91d0-4e88f0e8047e req-9662beb1-161f-4fad-a4ec-eac50efe1b37 tempest-TestShelveInstance-606039705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:56 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 Jul 03 01:24:56 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:56 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-785e0c10-f9f9-403c-91d0-4e88f0e8047e req-9662beb1-161f-4fad-a4ec-eac50efe1b37 tempest-TestShelveInstance-606039705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8" returned: 0 in 0.794s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-785e0c10-f9f9-403c-91d0-4e88f0e8047e req-9662beb1-161f-4fad-a4ec-eac50efe1b37 tempest-TestShelveInstance-606039705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:56 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 Jul 03 01:24:56 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:57 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-785e0c10-f9f9-403c-91d0-4e88f0e8047e req-9662beb1-161f-4fad-a4ec-eac50efe1b37 tempest-TestShelveInstance-606039705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8" returned: 1 in 0.747s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-785e0c10-f9f9-403c-91d0-4e88f0e8047e req-9662beb1-161f-4fad-a4ec-eac50efe1b37 tempest-TestShelveInstance-606039705 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:24:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-785e0c10-f9f9-403c-91d0-4e88f0e8047e req-9662beb1-161f-4fad-a4ec-eac50efe1b37 tempest-TestShelveInstance-606039705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:57 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8 Jul 03 01:24:57 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:58 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-785e0c10-f9f9-403c-91d0-4e88f0e8047e req-9662beb1-161f-4fad-a4ec-eac50efe1b37 tempest-TestShelveInstance-606039705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8" returned: 0 in 0.656s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-785e0c10-f9f9-403c-91d0-4e88f0e8047e req-9662beb1-161f-4fad-a4ec-eac50efe1b37 tempest-TestShelveInstance-606039705 None] Lock "cinder-quobyte-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8" released by "delete_volume" :: held 2.261s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:24:58 devstack cinder-volume[86772]: DEBUG cinder.quota [req-785e0c10-f9f9-403c-91d0-4e88f0e8047e req-9662beb1-161f-4fad-a4ec-eac50efe1b37 tempest-TestShelveInstance-606039705 None] Created reservations ['bd7a4cad-061f-4f0d-b4a4-f0f7e4142c5b', '7309edb8-b751-4071-a70f-25958a118322', 'cbbb95ca-e875-44c5-861b-12a1b985a16e', '10ac315f-82c1-4bec-98b0-e037bcb94198'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:24:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-785e0c10-f9f9-403c-91d0-4e88f0e8047e req-9662beb1-161f-4fad-a4ec-eac50efe1b37 tempest-TestShelveInstance-606039705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:24:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-785e0c10-f9f9-403c-91d0-4e88f0e8047e req-9662beb1-161f-4fad-a4ec-eac50efe1b37 tempest-TestShelveInstance-606039705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:24:58 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-785e0c10-f9f9-403c-91d0-4e88f0e8047e req-9662beb1-161f-4fad-a4ec-eac50efe1b37 tempest-TestShelveInstance-606039705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:24:58 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [req-785e0c10-f9f9-403c-91d0-4e88f0e8047e req-9662beb1-161f-4fad-a4ec-eac50efe1b37 tempest-TestShelveInstance-606039705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:24:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [req-785e0c10-f9f9-403c-91d0-4e88f0e8047e req-9662beb1-161f-4fad-a4ec-eac50efe1b37 tempest-TestShelveInstance-606039705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:24:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-785e0c10-f9f9-403c-91d0-4e88f0e8047e req-9662beb1-161f-4fad-a4ec-eac50efe1b37 tempest-TestShelveInstance-606039705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:24:58 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:24:58 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:24:59 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 03 01:24:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [req-785e0c10-f9f9-403c-91d0-4e88f0e8047e req-9662beb1-161f-4fad-a4ec-eac50efe1b37 tempest-TestShelveInstance-606039705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.633s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:24:59 devstack cinder-volume[86772]: DEBUG cinder.manager [req-785e0c10-f9f9-403c-91d0-4e88f0e8047e req-9662beb1-161f-4fad-a4ec-eac50efe1b37 tempest-TestShelveInstance-606039705 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:24:59 devstack cinder-volume[86772]: INFO cinder.volume.manager [req-785e0c10-f9f9-403c-91d0-4e88f0e8047e req-9662beb1-161f-4fad-a4ec-eac50efe1b37 tempest-TestShelveInstance-606039705 None] Deleted volume successfully. Jul 03 01:24:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [req-785e0c10-f9f9-403c-91d0-4e88f0e8047e req-9662beb1-161f-4fad-a4ec-eac50efe1b37 tempest-TestShelveInstance-606039705 None] Lock "cinder-5e5d6ec2-6bdd-402e-a043-e07e8f0755d8-delete_volume" released by "delete_volume" :: held 3.116s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:08 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=5 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:25:09 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=6,cinder:UPDATE=11,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:25:09 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:25:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Flow 'volume_create_manager' (dcbab03c-3124-4d8a-8cf7-24a292eb0669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:25:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (383502ce-2783-4560-9990-0a4d78a0b8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (383502ce-2783-4560-9990-0a4d78a0b8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1287561207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a5b71b-99ef-4697-afee-c9e3c9d8393a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c573ba56f74ba8916dd90c9055144a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:25:10Z,use_quota=True,user_id='f21c411bfe9841d8938d81f3b98c3ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63eadc5a-0fa4-45fa-be15-2e0c0c18a7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63eadc5a-0fa4-45fa-be15-2e0c0c18a7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b2bfb6c-9e28-4e37-a56f-64e2792948be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b2bfb6c-9e28-4e37-a56f-64e2792948be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44a5b71b-99ef-4697-afee-c9e3c9d8393a', 'volume_name': 'volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6abd95c-0d38-482d-bb7b-a79dd603bace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6abd95c-0d38-482d-bb7b-a79dd603bace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4b975f-24f6-4ebb-a336-6efcceef5b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:09 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Volume 44a5b71b-99ef-4697-afee-c9e3c9d8393a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a', 'volume_size': 1} Jul 03 01:25:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1287561207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a5b71b-99ef-4697-afee-c9e3c9d8393a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c573ba56f74ba8916dd90c9055144a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:25:10Z,use_quota=True,user_id='f21c411bfe9841d8938d81f3b98c3ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:25:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Creating volume 44a5b71b-99ef-4697-afee-c9e3c9d8393a {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:25:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:25:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:25:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:25:09 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:25:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:09 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a 1073741824 Jul 03 01:25:09 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:10 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a 1073741824" returned: 0 in 0.862s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:10 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a Jul 03 01:25:10 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:11 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a" returned: 0 in 0.628s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:25:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4b975f-24f6-4ebb-a336-6efcceef5b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0eeb6f-1a05-4e12-82aa-221aaa89cd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:11 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Volume volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a (44a5b71b-99ef-4697-afee-c9e3c9d8393a): created successfully Jul 03 01:25:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0eeb6f-1a05-4e12-82aa-221aaa89cd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Flow 'volume_create_manager' (dcbab03c-3124-4d8a-8cf7-24a292eb0669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:25:11 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9e460fae-7653-4188-aa23-eb1174fea233 tempest-VolumeDependencyTests-1816231964 None] Created volume successfully. Jul 03 01:25:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-baabacaf-a7da-4162-bbcc-4834553da927 tempest-VolumeDependencyTests-1816231964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-baabacaf-a7da-4162-bbcc-4834553da927 tempest-VolumeDependencyTests-1816231964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-baabacaf-a7da-4162-bbcc-4834553da927 tempest-VolumeDependencyTests-1816231964 None] Creating offline snapshot e380e43c-28a3-4213-aaf3-03a70cb88d10 of volume 44a5b71b-99ef-4697-afee-c9e3c9d8393a {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:25:12 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[991ca971-cefb-4c01-b574-f489420c26ce]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:25:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-baabacaf-a7da-4162-bbcc-4834553da927 tempest-VolumeDependencyTests-1816231964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:12 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a Jul 03 01:25:12 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:12 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-baabacaf-a7da-4162-bbcc-4834553da927 tempest-VolumeDependencyTests-1816231964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a" returned: 0 in 0.772s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-baabacaf-a7da-4162-bbcc-4834553da927 tempest-VolumeDependencyTests-1816231964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.e380e43c-28a3-4213-aaf3-03a70cb88d10 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:12 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.e380e43c-28a3-4213-aaf3-03a70cb88d10 1G Jul 03 01:25:12 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:25:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:25:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:25:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:12 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:25:12 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:13 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.704s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:25:13 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:25:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 29 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:25:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:25:13 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-baabacaf-a7da-4162-bbcc-4834553da927 tempest-VolumeDependencyTests-1816231964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.e380e43c-28a3-4213-aaf3-03a70cb88d10 1G" returned: 0 in 0.816s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-baabacaf-a7da-4162-bbcc-4834553da927 tempest-VolumeDependencyTests-1816231964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.e380e43c-28a3-4213-aaf3-03a70cb88d10 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:13 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.e380e43c-28a3-4213-aaf3-03a70cb88d10 Jul 03 01:25:13 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:14 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-baabacaf-a7da-4162-bbcc-4834553da927 tempest-VolumeDependencyTests-1816231964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.e380e43c-28a3-4213-aaf3-03a70cb88d10" returned: 0 in 0.714s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:14 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-baabacaf-a7da-4162-bbcc-4834553da927 tempest-VolumeDependencyTests-1816231964 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.e380e43c-28a3-4213-aaf3-03a70cb88d10 is being set with open permissions: ugo+rw Jul 03 01:25:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-baabacaf-a7da-4162-bbcc-4834553da927 tempest-VolumeDependencyTests-1816231964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.e380e43c-28a3-4213-aaf3-03a70cb88d10 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:14 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.e380e43c-28a3-4213-aaf3-03a70cb88d10 Jul 03 01:25:14 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:15 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-baabacaf-a7da-4162-bbcc-4834553da927 tempest-VolumeDependencyTests-1816231964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.e380e43c-28a3-4213-aaf3-03a70cb88d10" returned: 0 in 0.690s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-baabacaf-a7da-4162-bbcc-4834553da927 tempest-VolumeDependencyTests-1816231964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:15 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.info Jul 03 01:25:15 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:15 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-baabacaf-a7da-4162-bbcc-4834553da927 tempest-VolumeDependencyTests-1816231964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.info" returned: 0 in 0.682s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:15 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-baabacaf-a7da-4162-bbcc-4834553da927 tempest-VolumeDependencyTests-1816231964 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.info is being set with open permissions: ugo+rw Jul 03 01:25:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-baabacaf-a7da-4162-bbcc-4834553da927 tempest-VolumeDependencyTests-1816231964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:15 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.info Jul 03 01:25:15 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:16 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-baabacaf-a7da-4162-bbcc-4834553da927 tempest-VolumeDependencyTests-1816231964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.info" returned: 0 in 0.671s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-baabacaf-a7da-4162-bbcc-4834553da927 tempest-VolumeDependencyTests-1816231964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.444s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:16 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-baabacaf-a7da-4162-bbcc-4834553da927 tempest-VolumeDependencyTests-1816231964 None] Create snapshot completed successfully Jul 03 01:25:17 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:25:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Flow 'volume_create_manager' (076b86aa-3603-4b39-8d5f-49018b636c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:25:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1cd2a8a-dad1-4e91-9842-ff8f164f8669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1cd2a8a-dad1-4e91-9842-ff8f164f8669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1578581205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc73f50-52b4-4863-9281-6926043ae3d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c573ba56f74ba8916dd90c9055144a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e380e43c-28a3-4213-aaf3-03a70cb88d10,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:25:18Z,use_quota=True,user_id='f21c411bfe9841d8938d81f3b98c3ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c239b7a-b89e-446b-8cc5-27b11a2da1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c239b7a-b89e-446b-8cc5-27b11a2da1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa78f655-36ec-4559-a1b0-91aa52755368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa78f655-36ec-4559-a1b0-91aa52755368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1bc73f50-52b4-4863-9281-6926043ae3d2', 'volume_name': 'volume-1bc73f50-52b4-4863-9281-6926043ae3d2', 'volume_size': 1, 'snapshot_id': 'e380e43c-28a3-4213-aaf3-03a70cb88d10'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a289f6e7-74e8-4349-9c01-044222609cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a289f6e7-74e8-4349-9c01-044222609cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17316b08-f67f-4f57-bb40-beb1cc3a0b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:17 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Volume 1bc73f50-52b4-4863-9281-6926043ae3d2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1bc73f50-52b4-4863-9281-6926043ae3d2', 'volume_size': 1, 'snapshot_id': 'e380e43c-28a3-4213-aaf3-03a70cb88d10'} Jul 03 01:25:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Acquiring lock "cinder-quobyte-e380e43c-28a3-4213-aaf3-03a70cb88d10-1bc73f50-52b4-4863-9281-6926043ae3d2" by "_create_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Lock "cinder-quobyte-e380e43c-28a3-4213-aaf3-03a70cb88d10-1bc73f50-52b4-4863-9281-6926043ae3d2" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Creating volume 1bc73f50-52b4-4863-9281-6926043ae3d2 from snapshot e380e43c-28a3-4213-aaf3-03a70cb88d10 {{(pid=86772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 01:25:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:25:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:25:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:25:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Acquiring lock "cinder-quobyte-1bc73f50-52b4-4863-9281-6926043ae3d2" by "_copy_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Lock "cinder-quobyte-1bc73f50-52b4-4863-9281-6926043ae3d2" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] snapshot: e380e43c-28a3-4213-aaf3-03a70cb88d10, volume: 1bc73f50-52b4-4863-9281-6926043ae3d2, {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 01:25:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:25:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:25:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:18 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5501d5cc-5351-4b8d-a493-ae2413196f06]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:25:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.e380e43c-28a3-4213-aaf3-03a70cb88d10 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:18 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.e380e43c-28a3-4213-aaf3-03a70cb88d10 Jul 03 01:25:18 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:18 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.e380e43c-28a3-4213-aaf3-03a70cb88d10" returned: 0 in 0.867s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:25:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 01:25:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Creating direct copy from snapshot {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 01:25:18 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[87247b45-0c80-4357-a37d-7c766489f00e]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:25:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:19 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a Jul 03 01:25:19 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:19 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a" returned: 0 in 0.845s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:19 devstack cinder-volume[86772]: DEBUG cinder.utils [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Path /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1bc73f50-52b4-4863-9281-6926043ae3d2 not found in is_blk_device check {{(pid=86772) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 01:25:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1bc73f50-52b4-4863-9281-6926043ae3d2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:19 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1bc73f50-52b4-4863-9281-6926043ae3d2 Jul 03 01:25:19 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:24 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1bc73f50-52b4-4863-9281-6926043ae3d2" returned: 0 in 4.551s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:24 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc24716e-a53f-441c-8367-3d603a693cfd]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:25:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:24 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a Jul 03 01:25:24 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:25 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a" returned: 0 in 0.930s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:25 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Image conversion details: src /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a, size 1024.00 MB, duration 4.55 sec, destination /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1bc73f50-52b4-4863-9281-6926043ae3d2 {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:25:25 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Converted 1024.00 MB image at 224.93 MB/s Jul 03 01:25:25 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1bc73f50-52b4-4863-9281-6926043ae3d2 is being set with open permissions: ugo+rw Jul 03 01:25:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1bc73f50-52b4-4863-9281-6926043ae3d2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:25 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1bc73f50-52b4-4863-9281-6926043ae3d2 Jul 03 01:25:25 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:25 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1bc73f50-52b4-4863-9281-6926043ae3d2" returned: 0 in 0.633s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Lock "cinder-quobyte-1bc73f50-52b4-4863-9281-6926043ae3d2" released by "_copy_volume_from_snapshot" :: held 7.931s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Lock "cinder-quobyte-e380e43c-28a3-4213-aaf3-03a70cb88d10-1bc73f50-52b4-4863-9281-6926043ae3d2" released by "_create_volume_from_snapshot" :: held 7.960s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.978s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17316b08-f67f-4f57-bb40-beb1cc3a0b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bc73f50-52b4-4863-9281-6926043ae3d2', 'volume_size': 1, 'snapshot_id': 'e380e43c-28a3-4213-aaf3-03a70cb88d10'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6442caea-9494-4634-bc7f-2d88b1ba3246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:25 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Volume volume-1bc73f50-52b4-4863-9281-6926043ae3d2 (1bc73f50-52b4-4863-9281-6926043ae3d2): created successfully Jul 03 01:25:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6442caea-9494-4634-bc7f-2d88b1ba3246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Flow 'volume_create_manager' (076b86aa-3603-4b39-8d5f-49018b636c99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:25:26 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5a8ab53e-4153-451e-94ba-38bb0efaf96b tempest-VolumeDependencyTests-1816231964 None] Created volume successfully. Jul 03 01:25:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7340d8a4-addd-4195-a423-de79d616108a tempest-VolumeDependencyTests-1816231964 None] Acquiring lock "cinder-e380e43c-28a3-4213-aaf3-03a70cb88d10-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7340d8a4-addd-4195-a423-de79d616108a tempest-VolumeDependencyTests-1816231964 None] Lock "cinder-e380e43c-28a3-4213-aaf3-03a70cb88d10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7340d8a4-addd-4195-a423-de79d616108a tempest-VolumeDependencyTests-1816231964 None] Acquiring lock "cinder-quobyte-44a5b71b-99ef-4697-afee-c9e3c9d8393a" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7340d8a4-addd-4195-a423-de79d616108a tempest-VolumeDependencyTests-1816231964 None] Lock "cinder-quobyte-44a5b71b-99ef-4697-afee-c9e3c9d8393a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7340d8a4-addd-4195-a423-de79d616108a tempest-VolumeDependencyTests-1816231964 None] Acquiring lock "cinder-quobyte-e380e43c-28a3-4213-aaf3-03a70cb88d10" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7340d8a4-addd-4195-a423-de79d616108a tempest-VolumeDependencyTests-1816231964 None] Lock "cinder-quobyte-e380e43c-28a3-4213-aaf3-03a70cb88d10" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7340d8a4-addd-4195-a423-de79d616108a tempest-VolumeDependencyTests-1816231964 None] Deleting offline snapshot e380e43c-28a3-4213-aaf3-03a70cb88d10 of volume 44a5b71b-99ef-4697-afee-c9e3c9d8393a {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:25:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7340d8a4-addd-4195-a423-de79d616108a tempest-VolumeDependencyTests-1816231964 None] snapshot_file for this snap is: volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.e380e43c-28a3-4213-aaf3-03a70cb88d10 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:25:26 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f39d637-fea4-4ed3-8f49-f6c6eefd2670]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:25:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7340d8a4-addd-4195-a423-de79d616108a tempest-VolumeDependencyTests-1816231964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.e380e43c-28a3-4213-aaf3-03a70cb88d10 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:26 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.e380e43c-28a3-4213-aaf3-03a70cb88d10 Jul 03 01:25:26 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:27 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7340d8a4-addd-4195-a423-de79d616108a tempest-VolumeDependencyTests-1816231964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.e380e43c-28a3-4213-aaf3-03a70cb88d10" returned: 0 in 0.736s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7340d8a4-addd-4195-a423-de79d616108a tempest-VolumeDependencyTests-1816231964 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:25:27 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[84823a4a-3b6d-4791-a6a7-f8c9d72295a8]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:25:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7340d8a4-addd-4195-a423-de79d616108a tempest-VolumeDependencyTests-1816231964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:27 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a Jul 03 01:25:27 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:28 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7340d8a4-addd-4195-a423-de79d616108a tempest-VolumeDependencyTests-1816231964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a" returned: 0 in 0.737s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7340d8a4-addd-4195-a423-de79d616108a tempest-VolumeDependencyTests-1816231964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.e380e43c-28a3-4213-aaf3-03a70cb88d10 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:28 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.e380e43c-28a3-4213-aaf3-03a70cb88d10 Jul 03 01:25:28 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:28 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7340d8a4-addd-4195-a423-de79d616108a tempest-VolumeDependencyTests-1816231964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.e380e43c-28a3-4213-aaf3-03a70cb88d10" returned: 0 in 0.698s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7340d8a4-addd-4195-a423-de79d616108a tempest-VolumeDependencyTests-1816231964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.e380e43c-28a3-4213-aaf3-03a70cb88d10 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:28 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.e380e43c-28a3-4213-aaf3-03a70cb88d10 Jul 03 01:25:28 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:29 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7340d8a4-addd-4195-a423-de79d616108a tempest-VolumeDependencyTests-1816231964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a.e380e43c-28a3-4213-aaf3-03a70cb88d10" returned: 0 in 0.676s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7340d8a4-addd-4195-a423-de79d616108a tempest-VolumeDependencyTests-1816231964 None] Lock "cinder-quobyte-e380e43c-28a3-4213-aaf3-03a70cb88d10" released by "_delete_snapshot" :: held 2.938s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7340d8a4-addd-4195-a423-de79d616108a tempest-VolumeDependencyTests-1816231964 None] Lock "cinder-quobyte-44a5b71b-99ef-4697-afee-c9e3c9d8393a" released by "delete_snapshot" :: held 2.958s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:29 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-7340d8a4-addd-4195-a423-de79d616108a tempest-VolumeDependencyTests-1816231964 None] Created reservations ['8c1c199c-897e-4beb-98cf-d886ca763dbe', 'bc49e356-d753-4d50-89d7-1f860745b313', '7cf357a0-106b-4bbf-a7f5-18ae214e8896', '4d102236-0ce1-4407-99bb-f78057b3f0a5'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:25:29 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7340d8a4-addd-4195-a423-de79d616108a tempest-VolumeDependencyTests-1816231964 None] Delete snapshot completed successfully. Jul 03 01:25:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-7340d8a4-addd-4195-a423-de79d616108a tempest-VolumeDependencyTests-1816231964 None] Lock "cinder-e380e43c-28a3-4213-aaf3-03a70cb88d10-delete_snapshot" released by "delete_snapshot" :: held 3.098s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ee22ea73-7f88-470a-ab7a-488e79dbd628 tempest-VolumeDependencyTests-1816231964 None] Acquiring lock "cinder-44a5b71b-99ef-4697-afee-c9e3c9d8393a-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ee22ea73-7f88-470a-ab7a-488e79dbd628 tempest-VolumeDependencyTests-1816231964 None] Lock "cinder-44a5b71b-99ef-4697-afee-c9e3c9d8393a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ee22ea73-7f88-470a-ab7a-488e79dbd628 tempest-VolumeDependencyTests-1816231964 None] Acquiring lock "cinder-quobyte-44a5b71b-99ef-4697-afee-c9e3c9d8393a" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ee22ea73-7f88-470a-ab7a-488e79dbd628 tempest-VolumeDependencyTests-1816231964 None] Lock "cinder-quobyte-44a5b71b-99ef-4697-afee-c9e3c9d8393a" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:29 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a766bca-cf1c-480a-99ce-d14b29080087]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:25:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ee22ea73-7f88-470a-ab7a-488e79dbd628 tempest-VolumeDependencyTests-1816231964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:29 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a Jul 03 01:25:29 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:30 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ee22ea73-7f88-470a-ab7a-488e79dbd628 tempest-VolumeDependencyTests-1816231964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a" returned: 0 in 0.748s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ee22ea73-7f88-470a-ab7a-488e79dbd628 tempest-VolumeDependencyTests-1816231964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:30 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a Jul 03 01:25:30 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:31 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ee22ea73-7f88-470a-ab7a-488e79dbd628 tempest-VolumeDependencyTests-1816231964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-44a5b71b-99ef-4697-afee-c9e3c9d8393a" returned: 0 in 0.634s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ee22ea73-7f88-470a-ab7a-488e79dbd628 tempest-VolumeDependencyTests-1816231964 None] Lock "cinder-quobyte-44a5b71b-99ef-4697-afee-c9e3c9d8393a" released by "delete_volume" :: held 1.439s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:31 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-ee22ea73-7f88-470a-ab7a-488e79dbd628 tempest-VolumeDependencyTests-1816231964 None] Created reservations ['f1299d7b-f18a-4234-a31e-95e54eb34d1f', 'c8f04111-f68d-40fb-b283-8d23f28fb28c', '68621589-4703-4fd3-a794-28b5f16b7252', '4c43b207-f6df-4e3a-877f-444c546a4e7f'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:25:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ee22ea73-7f88-470a-ab7a-488e79dbd628 tempest-VolumeDependencyTests-1816231964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ee22ea73-7f88-470a-ab7a-488e79dbd628 tempest-VolumeDependencyTests-1816231964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ee22ea73-7f88-470a-ab7a-488e79dbd628 tempest-VolumeDependencyTests-1816231964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:25:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ee22ea73-7f88-470a-ab7a-488e79dbd628 tempest-VolumeDependencyTests-1816231964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:25:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ee22ea73-7f88-470a-ab7a-488e79dbd628 tempest-VolumeDependencyTests-1816231964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ee22ea73-7f88-470a-ab7a-488e79dbd628 tempest-VolumeDependencyTests-1816231964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:31 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:25:31 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8b441988-6eb3-44c3-b6e3-3347885773ab tempest-VolumeDependencyTests-1816231964 None] Acquiring lock "cinder-1bc73f50-52b4-4863-9281-6926043ae3d2-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8b441988-6eb3-44c3-b6e3-3347885773ab tempest-VolumeDependencyTests-1816231964 None] Lock "cinder-1bc73f50-52b4-4863-9281-6926043ae3d2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:32 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ee22ea73-7f88-470a-ab7a-488e79dbd628 tempest-VolumeDependencyTests-1816231964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.663s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:32 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-ee22ea73-7f88-470a-ab7a-488e79dbd628 tempest-VolumeDependencyTests-1816231964 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:25:32 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ee22ea73-7f88-470a-ab7a-488e79dbd628 tempest-VolumeDependencyTests-1816231964 None] Deleted volume successfully. Jul 03 01:25:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8b441988-6eb3-44c3-b6e3-3347885773ab tempest-VolumeDependencyTests-1816231964 None] Acquiring lock "cinder-quobyte-1bc73f50-52b4-4863-9281-6926043ae3d2" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ee22ea73-7f88-470a-ab7a-488e79dbd628 tempest-VolumeDependencyTests-1816231964 None] Lock "cinder-44a5b71b-99ef-4697-afee-c9e3c9d8393a-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8b441988-6eb3-44c3-b6e3-3347885773ab tempest-VolumeDependencyTests-1816231964 None] Lock "cinder-quobyte-1bc73f50-52b4-4863-9281-6926043ae3d2" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:32 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a3b081-fcf5-486c-ad3a-8ef2df93a5dd]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:25:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b441988-6eb3-44c3-b6e3-3347885773ab tempest-VolumeDependencyTests-1816231964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1bc73f50-52b4-4863-9281-6926043ae3d2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:32 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1bc73f50-52b4-4863-9281-6926043ae3d2 Jul 03 01:25:32 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:32 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b441988-6eb3-44c3-b6e3-3347885773ab tempest-VolumeDependencyTests-1816231964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1bc73f50-52b4-4863-9281-6926043ae3d2" returned: 0 in 0.734s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b441988-6eb3-44c3-b6e3-3347885773ab tempest-VolumeDependencyTests-1816231964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1bc73f50-52b4-4863-9281-6926043ae3d2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:32 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1bc73f50-52b4-4863-9281-6926043ae3d2 Jul 03 01:25:32 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:33 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b441988-6eb3-44c3-b6e3-3347885773ab tempest-VolumeDependencyTests-1816231964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1bc73f50-52b4-4863-9281-6926043ae3d2" returned: 0 in 0.635s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8b441988-6eb3-44c3-b6e3-3347885773ab tempest-VolumeDependencyTests-1816231964 None] Lock "cinder-quobyte-1bc73f50-52b4-4863-9281-6926043ae3d2" released by "delete_volume" :: held 1.408s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:33 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-8b441988-6eb3-44c3-b6e3-3347885773ab tempest-VolumeDependencyTests-1816231964 None] Created reservations ['f4d07f9a-a148-438d-b659-765a91e46ac9', '6024959c-f7b2-4019-bf2d-e704fadfe567', '6cf6ada6-bf84-4fcf-85b2-4b5d6607a3c4', 'a7d787ae-ba0e-4f3c-ac64-1a03663d4c1b'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:25:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8b441988-6eb3-44c3-b6e3-3347885773ab tempest-VolumeDependencyTests-1816231964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8b441988-6eb3-44c3-b6e3-3347885773ab tempest-VolumeDependencyTests-1816231964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8b441988-6eb3-44c3-b6e3-3347885773ab tempest-VolumeDependencyTests-1816231964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:25:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8b441988-6eb3-44c3-b6e3-3347885773ab tempest-VolumeDependencyTests-1816231964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:25:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8b441988-6eb3-44c3-b6e3-3347885773ab tempest-VolumeDependencyTests-1816231964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b441988-6eb3-44c3-b6e3-3347885773ab tempest-VolumeDependencyTests-1816231964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:33 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:25:33 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:34 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8b441988-6eb3-44c3-b6e3-3347885773ab tempest-VolumeDependencyTests-1816231964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.632s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:34 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-8b441988-6eb3-44c3-b6e3-3347885773ab tempest-VolumeDependencyTests-1816231964 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:25:34 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8b441988-6eb3-44c3-b6e3-3347885773ab tempest-VolumeDependencyTests-1816231964 None] Deleted volume successfully. Jul 03 01:25:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8b441988-6eb3-44c3-b6e3-3347885773ab tempest-VolumeDependencyTests-1816231964 None] Lock "cinder-1bc73f50-52b4-4863-9281-6926043ae3d2-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:37 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:25:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Flow 'volume_create_manager' (30fbe1a6-86d3-438a-b676-393a199e1499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:25:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69601ce6-ed0e-4bff-993a-97751c1deb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69601ce6-ed0e-4bff-993a-97751c1deb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-389082691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5214f8aa-b48f-4e38-b155-8b88fab1d4ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96371dfea40475a90f5d8374e2174ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:25:38Z,use_quota=True,user_id='cf73853ff42b4f499f2e488145744137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2ff7ff-cb88-4a6b-a1f1-a0dae4975321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2ff7ff-cb88-4a6b-a1f1-a0dae4975321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a08881-974c-4181-bd7f-8f5fb88cd8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a08881-974c-4181-bd7f-8f5fb88cd8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5214f8aa-b48f-4e38-b155-8b88fab1d4ed', 'volume_name': 'volume-5214f8aa-b48f-4e38-b155-8b88fab1d4ed', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358187e6-d4dc-4835-8b0a-df5c2ee0a6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358187e6-d4dc-4835-8b0a-df5c2ee0a6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (976a2307-adce-4aab-8b0d-4127c5e61388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:37 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Volume 5214f8aa-b48f-4e38-b155-8b88fab1d4ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5214f8aa-b48f-4e38-b155-8b88fab1d4ed', 'volume_size': 1} Jul 03 01:25:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-389082691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5214f8aa-b48f-4e38-b155-8b88fab1d4ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96371dfea40475a90f5d8374e2174ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:25:38Z,use_quota=True,user_id='cf73853ff42b4f499f2e488145744137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:25:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Creating volume 5214f8aa-b48f-4e38-b155-8b88fab1d4ed {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:25:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:25:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:25:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:25:37 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:25:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5214f8aa-b48f-4e38-b155-8b88fab1d4ed 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:37 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5214f8aa-b48f-4e38-b155-8b88fab1d4ed 1073741824 Jul 03 01:25:37 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:38 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5214f8aa-b48f-4e38-b155-8b88fab1d4ed 1073741824" returned: 0 in 0.848s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5214f8aa-b48f-4e38-b155-8b88fab1d4ed {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:38 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5214f8aa-b48f-4e38-b155-8b88fab1d4ed Jul 03 01:25:38 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:39 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5214f8aa-b48f-4e38-b155-8b88fab1d4ed" returned: 0 in 0.664s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:25:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (976a2307-adce-4aab-8b0d-4127c5e61388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5214f8aa-b48f-4e38-b155-8b88fab1d4ed', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4769fcf8-a6e5-4c46-80d8-1d2e4bc8be20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:39 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Volume volume-5214f8aa-b48f-4e38-b155-8b88fab1d4ed (5214f8aa-b48f-4e38-b155-8b88fab1d4ed): created successfully Jul 03 01:25:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4769fcf8-a6e5-4c46-80d8-1d2e4bc8be20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Flow 'volume_create_manager' (30fbe1a6-86d3-438a-b676-393a199e1499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:25:39 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-921efc47-b270-4b6e-8d29-f9424097b13c tempest-ProjectReaderTests-620205699 None] Created volume successfully. Jul 03 01:25:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-266fc126-0f7d-464b-b9ec-b3f8ab57555e tempest-ProjectReaderTests-620205699 None] Acquiring lock "cinder-5214f8aa-b48f-4e38-b155-8b88fab1d4ed-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-266fc126-0f7d-464b-b9ec-b3f8ab57555e tempest-ProjectReaderTests-620205699 None] Lock "cinder-5214f8aa-b48f-4e38-b155-8b88fab1d4ed-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-266fc126-0f7d-464b-b9ec-b3f8ab57555e tempest-ProjectReaderTests-620205699 None] Acquiring lock "cinder-quobyte-5214f8aa-b48f-4e38-b155-8b88fab1d4ed" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-266fc126-0f7d-464b-b9ec-b3f8ab57555e tempest-ProjectReaderTests-620205699 None] Lock "cinder-quobyte-5214f8aa-b48f-4e38-b155-8b88fab1d4ed" acquired by "delete_volume" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:39 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bda603-0f78-45c1-9f9b-03bf260a0d72]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:25:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-266fc126-0f7d-464b-b9ec-b3f8ab57555e tempest-ProjectReaderTests-620205699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5214f8aa-b48f-4e38-b155-8b88fab1d4ed {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:40 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5214f8aa-b48f-4e38-b155-8b88fab1d4ed Jul 03 01:25:40 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:40 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-266fc126-0f7d-464b-b9ec-b3f8ab57555e tempest-ProjectReaderTests-620205699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5214f8aa-b48f-4e38-b155-8b88fab1d4ed" returned: 0 in 0.770s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-266fc126-0f7d-464b-b9ec-b3f8ab57555e tempest-ProjectReaderTests-620205699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5214f8aa-b48f-4e38-b155-8b88fab1d4ed {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:40 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5214f8aa-b48f-4e38-b155-8b88fab1d4ed Jul 03 01:25:40 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:41 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-266fc126-0f7d-464b-b9ec-b3f8ab57555e tempest-ProjectReaderTests-620205699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5214f8aa-b48f-4e38-b155-8b88fab1d4ed" returned: 0 in 0.631s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-266fc126-0f7d-464b-b9ec-b3f8ab57555e tempest-ProjectReaderTests-620205699 None] Lock "cinder-quobyte-5214f8aa-b48f-4e38-b155-8b88fab1d4ed" released by "delete_volume" :: held 1.442s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:41 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-266fc126-0f7d-464b-b9ec-b3f8ab57555e tempest-ProjectReaderTests-620205699 None] Created reservations ['efba4362-b63b-411e-b428-b423a217af90', '996a7ac0-82a5-4099-8899-46747e14c1ac', 'f024aa95-6e4f-45b8-ba2c-f4aef2993416', '69993096-523b-4e40-992b-ddbf7b3a863f'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:25:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-266fc126-0f7d-464b-b9ec-b3f8ab57555e tempest-ProjectReaderTests-620205699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-266fc126-0f7d-464b-b9ec-b3f8ab57555e tempest-ProjectReaderTests-620205699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-266fc126-0f7d-464b-b9ec-b3f8ab57555e tempest-ProjectReaderTests-620205699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:25:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-266fc126-0f7d-464b-b9ec-b3f8ab57555e tempest-ProjectReaderTests-620205699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:25:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-266fc126-0f7d-464b-b9ec-b3f8ab57555e tempest-ProjectReaderTests-620205699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-266fc126-0f7d-464b-b9ec-b3f8ab57555e tempest-ProjectReaderTests-620205699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:41 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:25:41 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:42 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-266fc126-0f7d-464b-b9ec-b3f8ab57555e tempest-ProjectReaderTests-620205699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.648s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:42 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-266fc126-0f7d-464b-b9ec-b3f8ab57555e tempest-ProjectReaderTests-620205699 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:25:42 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-266fc126-0f7d-464b-b9ec-b3f8ab57555e tempest-ProjectReaderTests-620205699 None] Deleted volume successfully. Jul 03 01:25:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-266fc126-0f7d-464b-b9ec-b3f8ab57555e tempest-ProjectReaderTests-620205699 None] Lock "cinder-5214f8aa-b48f-4e38-b155-8b88fab1d4ed-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:42 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:25:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Flow 'volume_create_manager' (7199fdec-5892-43a5-98b2-66ad5382e077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:25:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb2b7ca-bb86-4cb4-858e-0ca9cd50004d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb2b7ca-bb86-4cb4-858e-0ca9cd50004d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-341920417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c38c320-d8b9-4fcc-804b-d9392da188c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96371dfea40475a90f5d8374e2174ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:25:42Z,use_quota=True,user_id='cf73853ff42b4f499f2e488145744137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73cb1745-cf19-430c-b189-1f72a99c7419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73cb1745-cf19-430c-b189-1f72a99c7419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0778dbf-1cdc-4e60-8a93-db2cb6b6fe9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0778dbf-1cdc-4e60-8a93-db2cb6b6fe9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c38c320-d8b9-4fcc-804b-d9392da188c8', 'volume_name': 'volume-4c38c320-d8b9-4fcc-804b-d9392da188c8', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (795bb492-d80a-496d-9554-19830ab7d36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (795bb492-d80a-496d-9554-19830ab7d36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e06ab4-2d3e-49ba-af9c-342ed47ea9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:42 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Volume 4c38c320-d8b9-4fcc-804b-d9392da188c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c38c320-d8b9-4fcc-804b-d9392da188c8', 'volume_size': 1} Jul 03 01:25:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-341920417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c38c320-d8b9-4fcc-804b-d9392da188c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96371dfea40475a90f5d8374e2174ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:25:42Z,use_quota=True,user_id='cf73853ff42b4f499f2e488145744137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:25:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Creating volume 4c38c320-d8b9-4fcc-804b-d9392da188c8 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:25:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:25:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:25:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:25:42 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:25:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4c38c320-d8b9-4fcc-804b-d9392da188c8 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:42 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4c38c320-d8b9-4fcc-804b-d9392da188c8 1073741824 Jul 03 01:25:42 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:43 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4c38c320-d8b9-4fcc-804b-d9392da188c8 1073741824" returned: 0 in 0.836s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4c38c320-d8b9-4fcc-804b-d9392da188c8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:43 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4c38c320-d8b9-4fcc-804b-d9392da188c8 Jul 03 01:25:43 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:44 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4c38c320-d8b9-4fcc-804b-d9392da188c8" returned: 0 in 0.665s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:25:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e06ab4-2d3e-49ba-af9c-342ed47ea9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c38c320-d8b9-4fcc-804b-d9392da188c8', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa8e1aa-0637-454f-9b9c-a57422a6f6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:44 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Volume volume-4c38c320-d8b9-4fcc-804b-d9392da188c8 (4c38c320-d8b9-4fcc-804b-d9392da188c8): created successfully Jul 03 01:25:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa8e1aa-0637-454f-9b9c-a57422a6f6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Flow 'volume_create_manager' (7199fdec-5892-43a5-98b2-66ad5382e077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:25:44 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-66d4c49e-a764-4702-a04a-22d6083f3840 tempest-ProjectReaderTests-620205699 None] Created volume successfully. Jul 03 01:25:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b225f58e-30ba-4741-a7a6-11287afe25f3 tempest-ProjectReaderTests-620205699 None] Acquiring lock "cinder-4c38c320-d8b9-4fcc-804b-d9392da188c8-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b225f58e-30ba-4741-a7a6-11287afe25f3 tempest-ProjectReaderTests-620205699 None] Lock "cinder-4c38c320-d8b9-4fcc-804b-d9392da188c8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b225f58e-30ba-4741-a7a6-11287afe25f3 tempest-ProjectReaderTests-620205699 None] Acquiring lock "cinder-quobyte-4c38c320-d8b9-4fcc-804b-d9392da188c8" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b225f58e-30ba-4741-a7a6-11287afe25f3 tempest-ProjectReaderTests-620205699 None] Lock "cinder-quobyte-4c38c320-d8b9-4fcc-804b-d9392da188c8" acquired by "delete_volume" :: waited 0.014s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:44 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd58457-6b05-4262-9d21-89655e52518f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:25:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b225f58e-30ba-4741-a7a6-11287afe25f3 tempest-ProjectReaderTests-620205699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4c38c320-d8b9-4fcc-804b-d9392da188c8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:44 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4c38c320-d8b9-4fcc-804b-d9392da188c8 Jul 03 01:25:44 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:45 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b225f58e-30ba-4741-a7a6-11287afe25f3 tempest-ProjectReaderTests-620205699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4c38c320-d8b9-4fcc-804b-d9392da188c8" returned: 0 in 0.780s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b225f58e-30ba-4741-a7a6-11287afe25f3 tempest-ProjectReaderTests-620205699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4c38c320-d8b9-4fcc-804b-d9392da188c8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:45 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4c38c320-d8b9-4fcc-804b-d9392da188c8 Jul 03 01:25:45 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:46 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b225f58e-30ba-4741-a7a6-11287afe25f3 tempest-ProjectReaderTests-620205699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-4c38c320-d8b9-4fcc-804b-d9392da188c8" returned: 0 in 0.629s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b225f58e-30ba-4741-a7a6-11287afe25f3 tempest-ProjectReaderTests-620205699 None] Lock "cinder-quobyte-4c38c320-d8b9-4fcc-804b-d9392da188c8" released by "delete_volume" :: held 1.446s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:46 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-b225f58e-30ba-4741-a7a6-11287afe25f3 tempest-ProjectReaderTests-620205699 None] Created reservations ['03e186fe-9ef2-4157-b3f0-9d60c020a23a', '6e18f9af-98c6-49a6-bb60-11b1b5606367', '2b7a1098-8fc2-456f-b912-9d8515c0a12f', '651cc5e7-1354-4583-ade6-b0d6b4662055'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:25:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b225f58e-30ba-4741-a7a6-11287afe25f3 tempest-ProjectReaderTests-620205699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b225f58e-30ba-4741-a7a6-11287afe25f3 tempest-ProjectReaderTests-620205699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b225f58e-30ba-4741-a7a6-11287afe25f3 tempest-ProjectReaderTests-620205699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:25:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b225f58e-30ba-4741-a7a6-11287afe25f3 tempest-ProjectReaderTests-620205699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:25:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b225f58e-30ba-4741-a7a6-11287afe25f3 tempest-ProjectReaderTests-620205699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b225f58e-30ba-4741-a7a6-11287afe25f3 tempest-ProjectReaderTests-620205699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:46 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:25:46 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:46 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b225f58e-30ba-4741-a7a6-11287afe25f3 tempest-ProjectReaderTests-620205699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.674s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:46 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-b225f58e-30ba-4741-a7a6-11287afe25f3 tempest-ProjectReaderTests-620205699 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:25:46 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b225f58e-30ba-4741-a7a6-11287afe25f3 tempest-ProjectReaderTests-620205699 None] Deleted volume successfully. Jul 03 01:25:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b225f58e-30ba-4741-a7a6-11287afe25f3 tempest-ProjectReaderTests-620205699 None] Lock "cinder-4c38c320-d8b9-4fcc-804b-d9392da188c8-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:47 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:25:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Flow 'volume_create_manager' (c5959d10-78a5-4f03-8782-4f155999d8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:25:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51bca6e5-990b-476b-8b7e-f84c8033b3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51bca6e5-990b-476b-8b7e-f84c8033b3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-774142097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1adee503-d241-43f3-83a3-14932ac650b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96371dfea40475a90f5d8374e2174ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:25:47Z,use_quota=True,user_id='cf73853ff42b4f499f2e488145744137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9992869-4d4b-4d73-bf14-9a3bad800bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9992869-4d4b-4d73-bf14-9a3bad800bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678ae13a-27b8-4ca4-8941-c2948ff390ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678ae13a-27b8-4ca4-8941-c2948ff390ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1adee503-d241-43f3-83a3-14932ac650b7', 'volume_name': 'volume-1adee503-d241-43f3-83a3-14932ac650b7', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48fb996b-f972-4e0c-b61d-13834cd9d93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48fb996b-f972-4e0c-b61d-13834cd9d93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321d4d29-947f-455d-857c-cb05dee3d97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:47 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Volume 1adee503-d241-43f3-83a3-14932ac650b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1adee503-d241-43f3-83a3-14932ac650b7', 'volume_size': 1} Jul 03 01:25:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-774142097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1adee503-d241-43f3-83a3-14932ac650b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96371dfea40475a90f5d8374e2174ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:25:47Z,use_quota=True,user_id='cf73853ff42b4f499f2e488145744137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:25:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Creating volume 1adee503-d241-43f3-83a3-14932ac650b7 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:25:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:25:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:25:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:25:47 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:25:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1adee503-d241-43f3-83a3-14932ac650b7 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:47 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1adee503-d241-43f3-83a3-14932ac650b7 1073741824 Jul 03 01:25:47 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:48 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1adee503-d241-43f3-83a3-14932ac650b7 1073741824" returned: 0 in 0.805s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1adee503-d241-43f3-83a3-14932ac650b7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:48 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1adee503-d241-43f3-83a3-14932ac650b7 Jul 03 01:25:48 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:48 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1adee503-d241-43f3-83a3-14932ac650b7" returned: 0 in 0.624s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:25:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321d4d29-947f-455d-857c-cb05dee3d97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1adee503-d241-43f3-83a3-14932ac650b7', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c6ee67-8803-433a-9b76-654c2c505ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:48 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Volume volume-1adee503-d241-43f3-83a3-14932ac650b7 (1adee503-d241-43f3-83a3-14932ac650b7): created successfully Jul 03 01:25:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c6ee67-8803-433a-9b76-654c2c505ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Flow 'volume_create_manager' (c5959d10-78a5-4f03-8782-4f155999d8d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:25:48 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-0ae67d57-d980-4191-8e2d-8a4f954ada58 tempest-ProjectReaderTests-620205699 None] Created volume successfully. Jul 03 01:25:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d9bd4cde-73e0-455c-8f5d-4c0fef9c8bd0 tempest-ProjectReaderTests-620205699 None] Acquiring lock "cinder-1adee503-d241-43f3-83a3-14932ac650b7-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d9bd4cde-73e0-455c-8f5d-4c0fef9c8bd0 tempest-ProjectReaderTests-620205699 None] Lock "cinder-1adee503-d241-43f3-83a3-14932ac650b7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d9bd4cde-73e0-455c-8f5d-4c0fef9c8bd0 tempest-ProjectReaderTests-620205699 None] Acquiring lock "cinder-quobyte-1adee503-d241-43f3-83a3-14932ac650b7" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d9bd4cde-73e0-455c-8f5d-4c0fef9c8bd0 tempest-ProjectReaderTests-620205699 None] Lock "cinder-quobyte-1adee503-d241-43f3-83a3-14932ac650b7" acquired by "delete_volume" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:49 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b762b416-9378-4cd6-b975-43246a7363b8]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:25:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d9bd4cde-73e0-455c-8f5d-4c0fef9c8bd0 tempest-ProjectReaderTests-620205699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1adee503-d241-43f3-83a3-14932ac650b7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:49 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1adee503-d241-43f3-83a3-14932ac650b7 Jul 03 01:25:49 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:50 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d9bd4cde-73e0-455c-8f5d-4c0fef9c8bd0 tempest-ProjectReaderTests-620205699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1adee503-d241-43f3-83a3-14932ac650b7" returned: 0 in 0.776s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d9bd4cde-73e0-455c-8f5d-4c0fef9c8bd0 tempest-ProjectReaderTests-620205699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1adee503-d241-43f3-83a3-14932ac650b7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:50 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1adee503-d241-43f3-83a3-14932ac650b7 Jul 03 01:25:50 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:50 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d9bd4cde-73e0-455c-8f5d-4c0fef9c8bd0 tempest-ProjectReaderTests-620205699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1adee503-d241-43f3-83a3-14932ac650b7" returned: 0 in 0.658s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d9bd4cde-73e0-455c-8f5d-4c0fef9c8bd0 tempest-ProjectReaderTests-620205699 None] Lock "cinder-quobyte-1adee503-d241-43f3-83a3-14932ac650b7" released by "delete_volume" :: held 1.473s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:51 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-d9bd4cde-73e0-455c-8f5d-4c0fef9c8bd0 tempest-ProjectReaderTests-620205699 None] Created reservations ['d00b5976-66d0-45ad-958f-e1baa8c6e838', '4bc3794c-b3e6-4b0d-8af7-f19716847560', 'fd9df450-d047-4d98-b265-833257487dbc', '04354c10-c53a-4581-96a9-0082bbc12b44'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:25:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d9bd4cde-73e0-455c-8f5d-4c0fef9c8bd0 tempest-ProjectReaderTests-620205699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d9bd4cde-73e0-455c-8f5d-4c0fef9c8bd0 tempest-ProjectReaderTests-620205699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:51 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d9bd4cde-73e0-455c-8f5d-4c0fef9c8bd0 tempest-ProjectReaderTests-620205699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:25:51 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-d9bd4cde-73e0-455c-8f5d-4c0fef9c8bd0 tempest-ProjectReaderTests-620205699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:25:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-d9bd4cde-73e0-455c-8f5d-4c0fef9c8bd0 tempest-ProjectReaderTests-620205699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d9bd4cde-73e0-455c-8f5d-4c0fef9c8bd0 tempest-ProjectReaderTests-620205699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:51 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:25:51 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:51 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-d9bd4cde-73e0-455c-8f5d-4c0fef9c8bd0 tempest-ProjectReaderTests-620205699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.700s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:51 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-d9bd4cde-73e0-455c-8f5d-4c0fef9c8bd0 tempest-ProjectReaderTests-620205699 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:25:51 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-d9bd4cde-73e0-455c-8f5d-4c0fef9c8bd0 tempest-ProjectReaderTests-620205699 None] Deleted volume successfully. Jul 03 01:25:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d9bd4cde-73e0-455c-8f5d-4c0fef9c8bd0 tempest-ProjectReaderTests-620205699 None] Lock "cinder-1adee503-d241-43f3-83a3-14932ac650b7-delete_volume" released by "delete_volume" :: held 2.364s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:52 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:25:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Flow 'volume_create_manager' (ff2cc1e6-b5b0-40ad-987a-4964257c5c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:25:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add8d64c-3674-4b39-8a2a-e0a8b45b1818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add8d64c-3674-4b39-8a2a-e0a8b45b1818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1760807888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7bd5a3c-62e3-419f-a887-cbbd623b2201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96371dfea40475a90f5d8374e2174ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:25:52Z,use_quota=True,user_id='cf73853ff42b4f499f2e488145744137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc552f93-1196-41b8-b700-cdd9493ae23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc552f93-1196-41b8-b700-cdd9493ae23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4257b53a-c4a2-485e-b48a-484ae7e9204c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4257b53a-c4a2-485e-b48a-484ae7e9204c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7bd5a3c-62e3-419f-a887-cbbd623b2201', 'volume_name': 'volume-c7bd5a3c-62e3-419f-a887-cbbd623b2201', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68784c0f-407e-4689-9eca-1a9c0aa11721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68784c0f-407e-4689-9eca-1a9c0aa11721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:52 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13ba6ff-d3e8-4984-94c1-e62e487f071d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:52 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Volume c7bd5a3c-62e3-419f-a887-cbbd623b2201: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7bd5a3c-62e3-419f-a887-cbbd623b2201', 'volume_size': 1} Jul 03 01:25:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1760807888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7bd5a3c-62e3-419f-a887-cbbd623b2201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96371dfea40475a90f5d8374e2174ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:25:52Z,use_quota=True,user_id='cf73853ff42b4f499f2e488145744137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:25:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Creating volume c7bd5a3c-62e3-419f-a887-cbbd623b2201 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:25:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:25:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:25:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:52 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:25:52 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:25:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c7bd5a3c-62e3-419f-a887-cbbd623b2201 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:52 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c7bd5a3c-62e3-419f-a887-cbbd623b2201 1073741824 Jul 03 01:25:52 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:52 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c7bd5a3c-62e3-419f-a887-cbbd623b2201 1073741824" returned: 0 in 0.814s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c7bd5a3c-62e3-419f-a887-cbbd623b2201 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:53 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c7bd5a3c-62e3-419f-a887-cbbd623b2201 Jul 03 01:25:53 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:53 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c7bd5a3c-62e3-419f-a887-cbbd623b2201" returned: 0 in 0.656s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:53 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:25:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13ba6ff-d3e8-4984-94c1-e62e487f071d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7bd5a3c-62e3-419f-a887-cbbd623b2201', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb9ee67-9455-46e2-ae6f-0d601cda38d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:25:53 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Volume volume-c7bd5a3c-62e3-419f-a887-cbbd623b2201 (c7bd5a3c-62e3-419f-a887-cbbd623b2201): created successfully Jul 03 01:25:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb9ee67-9455-46e2-ae6f-0d601cda38d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:25:53 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Flow 'volume_create_manager' (ff2cc1e6-b5b0-40ad-987a-4964257c5c95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:25:53 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-0c9c22a4-7572-47ab-900f-61f002c5a86d tempest-ProjectReaderTests-620205699 None] Created volume successfully. Jul 03 01:25:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-87ad97c6-9b1b-4057-8280-bc79280034de tempest-ProjectReaderTests-620205699 None] Acquiring lock "cinder-c7bd5a3c-62e3-419f-a887-cbbd623b2201-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-87ad97c6-9b1b-4057-8280-bc79280034de tempest-ProjectReaderTests-620205699 None] Lock "cinder-c7bd5a3c-62e3-419f-a887-cbbd623b2201-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-87ad97c6-9b1b-4057-8280-bc79280034de tempest-ProjectReaderTests-620205699 None] Acquiring lock "cinder-quobyte-c7bd5a3c-62e3-419f-a887-cbbd623b2201" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:25:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-87ad97c6-9b1b-4057-8280-bc79280034de tempest-ProjectReaderTests-620205699 None] Lock "cinder-quobyte-c7bd5a3c-62e3-419f-a887-cbbd623b2201" acquired by "delete_volume" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:25:54 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c83f87d-369c-4de9-bec4-10fb5fe57215]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:25:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-87ad97c6-9b1b-4057-8280-bc79280034de tempest-ProjectReaderTests-620205699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c7bd5a3c-62e3-419f-a887-cbbd623b2201 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:54 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c7bd5a3c-62e3-419f-a887-cbbd623b2201 Jul 03 01:25:54 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:55 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-87ad97c6-9b1b-4057-8280-bc79280034de tempest-ProjectReaderTests-620205699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c7bd5a3c-62e3-419f-a887-cbbd623b2201" returned: 0 in 0.743s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-87ad97c6-9b1b-4057-8280-bc79280034de tempest-ProjectReaderTests-620205699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c7bd5a3c-62e3-419f-a887-cbbd623b2201 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:55 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c7bd5a3c-62e3-419f-a887-cbbd623b2201 Jul 03 01:25:55 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:55 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-87ad97c6-9b1b-4057-8280-bc79280034de tempest-ProjectReaderTests-620205699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c7bd5a3c-62e3-419f-a887-cbbd623b2201" returned: 0 in 0.640s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-87ad97c6-9b1b-4057-8280-bc79280034de tempest-ProjectReaderTests-620205699 None] Lock "cinder-quobyte-c7bd5a3c-62e3-419f-a887-cbbd623b2201" released by "delete_volume" :: held 1.421s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:25:55 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-87ad97c6-9b1b-4057-8280-bc79280034de tempest-ProjectReaderTests-620205699 None] Created reservations ['5c70e0e7-5f00-4451-a36c-b2691b3d5093', 'ca1dc5aa-46d4-46ff-b851-a0557275e15d', 'e95eb867-52f7-43a8-8d3a-7158e9d8095a', 'fd5e70cf-a1ec-4b9b-b59f-e9939f4cfa75'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:25:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-87ad97c6-9b1b-4057-8280-bc79280034de tempest-ProjectReaderTests-620205699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:25:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-87ad97c6-9b1b-4057-8280-bc79280034de tempest-ProjectReaderTests-620205699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:25:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-87ad97c6-9b1b-4057-8280-bc79280034de tempest-ProjectReaderTests-620205699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:25:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-87ad97c6-9b1b-4057-8280-bc79280034de tempest-ProjectReaderTests-620205699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:25:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-87ad97c6-9b1b-4057-8280-bc79280034de tempest-ProjectReaderTests-620205699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:25:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-87ad97c6-9b1b-4057-8280-bc79280034de tempest-ProjectReaderTests-620205699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:25:55 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:25:55 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:25:56 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 03 01:25:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-87ad97c6-9b1b-4057-8280-bc79280034de tempest-ProjectReaderTests-620205699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.651s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:25:56 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-87ad97c6-9b1b-4057-8280-bc79280034de tempest-ProjectReaderTests-620205699 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:25:56 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-87ad97c6-9b1b-4057-8280-bc79280034de tempest-ProjectReaderTests-620205699 None] Deleted volume successfully. Jul 03 01:25:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-87ad97c6-9b1b-4057-8280-bc79280034de tempest-ProjectReaderTests-620205699 None] Lock "cinder-c7bd5a3c-62e3-419f-a887-cbbd623b2201-delete_volume" released by "delete_volume" :: held 2.258s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:06 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=73,cinder:SELECT=54,cinder:INSERT=19,cinder:DELETE=5 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:26:07 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=50,cinder:UPDATE=72,cinder:DELETE=8,cinder:INSERT=15 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Flow 'volume_create_manager' (6a709bdc-2066-4854-a63d-1ec718ce0c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ee4a05-068f-471b-bf6b-6d5575a1e1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ee4a05-068f-471b-bf6b-6d5575a1e1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-61349188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=160d93de-4940-4b21-9227-7a08f5637cf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c956f47829f49b4845e2c7549a92338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:08Z,use_quota=True,user_id='c83bdb041be34915a5dd42f787a7f279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cbc2243-f4a9-4ce1-9678-e2e69229d3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cbc2243-f4a9-4ce1-9678-e2e69229d3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fecf9f56-700a-4573-9710-4108dd184c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fecf9f56-700a-4573-9710-4108dd184c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '160d93de-4940-4b21-9227-7a08f5637cf0', 'volume_name': 'volume-160d93de-4940-4b21-9227-7a08f5637cf0', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f772be2-3a54-4313-817a-ca23e4bac738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f772be2-3a54-4313-817a-ca23e4bac738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c03dc94-048d-404e-81a2-453ba45a600b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:08 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Volume 160d93de-4940-4b21-9227-7a08f5637cf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-160d93de-4940-4b21-9227-7a08f5637cf0', 'volume_size': 1} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-61349188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=160d93de-4940-4b21-9227-7a08f5637cf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c956f47829f49b4845e2c7549a92338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:08Z,use_quota=True,user_id='c83bdb041be34915a5dd42f787a7f279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Creating volume 160d93de-4940-4b21-9227-7a08f5637cf0 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:26:08 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-160d93de-4940-4b21-9227-7a08f5637cf0 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:08 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-160d93de-4940-4b21-9227-7a08f5637cf0 1073741824 Jul 03 01:26:08 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Flow 'volume_create_manager' (1915aaf6-dbda-49dd-9339-9107907bb153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb6f9fbe-b4da-47af-9af2-1d31b6bb2022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb6f9fbe-b4da-47af-9af2-1d31b6bb2022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-296279841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd5c8c17-bfda-48de-ae8e-92ac4cffcd66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d539b1dece4644adb55fcef6ee3858a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:09Z,use_quota=True,user_id='57326ac8ac444f7b89113fe37c762a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df17925e-945e-4f9e-ab85-7e3970983148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df17925e-945e-4f9e-ab85-7e3970983148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (432e7cb0-72db-44b8-9444-50903feb9b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (432e7cb0-72db-44b8-9444-50903feb9b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd5c8c17-bfda-48de-ae8e-92ac4cffcd66', 'volume_name': 'volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae4d87a-bca7-41db-b204-534aeb59e6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae4d87a-bca7-41db-b204-534aeb59e6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f431b022-11dd-451b-a3cf-47335e7b46ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:08 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Volume bd5c8c17-bfda-48de-ae8e-92ac4cffcd66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66', 'volume_size': 1} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Flow 'volume_create_manager' (9712b391-0512-4551-a772-f899b0ab4f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe97886a-c719-46cd-8098-cb2083f905cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe97886a-c719-46cd-8098-cb2083f905cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1622376929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9315ea-b8df-43bd-a698-0bb0a6060997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c956f47829f49b4845e2c7549a92338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:09Z,use_quota=True,user_id='c83bdb041be34915a5dd42f787a7f279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4d1058-5b8b-4b12-991a-59e3986836a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4d1058-5b8b-4b12-991a-59e3986836a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9390314-2b1c-4b27-8dbf-cdc8ecef74d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:08 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9390314-2b1c-4b27-8dbf-cdc8ecef74d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd9315ea-b8df-43bd-a698-0bb0a6060997', 'volume_name': 'volume-dd9315ea-b8df-43bd-a698-0bb0a6060997', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7614757-bf9d-42d4-8647-76a27a8ba906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7614757-bf9d-42d4-8647-76a27a8ba906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11408e6a-d4fb-451e-aae3-3885a1ea8829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:09 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Volume dd9315ea-b8df-43bd-a698-0bb0a6060997: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd9315ea-b8df-43bd-a698-0bb0a6060997', 'volume_size': 1} Jul 03 01:26:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:09 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:26:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Flow 'volume_create_manager' (65520715-7211-48ad-9b3c-aa8342fff2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4cdad28-7a95-440f-87e2-96de30227a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4cdad28-7a95-440f-87e2-96de30227a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-155687353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f30c961-2eb7-4d95-9e4b-240b61bcf146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c956f47829f49b4845e2c7549a92338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:09Z,use_quota=True,user_id='c83bdb041be34915a5dd42f787a7f279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d32b2054-bd5f-4694-89ff-c5d79a0f0a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d32b2054-bd5f-4694-89ff-c5d79a0f0a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cdd0a47-1719-4954-8d04-61f44905b0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cdd0a47-1719-4954-8d04-61f44905b0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f30c961-2eb7-4d95-9e4b-240b61bcf146', 'volume_name': 'volume-2f30c961-2eb7-4d95-9e4b-240b61bcf146', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdbe7669-7087-4e5c-aaa8-cb47a4bf9175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdbe7669-7087-4e5c-aaa8-cb47a4bf9175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2bc5143-ba30-4d5c-9b0d-6f3aeaf6493f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:09 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Volume 2f30c961-2eb7-4d95-9e4b-240b61bcf146: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f30c961-2eb7-4d95-9e4b-240b61bcf146', 'volume_size': 1} Jul 03 01:26:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:10 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:26:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Flow 'volume_create_manager' (bb244cd7-9857-4f0d-845d-e8a636708c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c84f068-b057-4dcc-8a4c-a3b2eae933f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c84f068-b057-4dcc-8a4c-a3b2eae933f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1790809107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c164da12-a9ea-4b94-82b2-0f2cf3b929af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c956f47829f49b4845e2c7549a92338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:10Z,use_quota=True,user_id='c83bdb041be34915a5dd42f787a7f279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85846ab8-f463-4498-9b79-4d498815141c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85846ab8-f463-4498-9b79-4d498815141c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83aee736-124a-47b5-9fa4-585449803540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83aee736-124a-47b5-9fa4-585449803540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c164da12-a9ea-4b94-82b2-0f2cf3b929af', 'volume_name': 'volume-c164da12-a9ea-4b94-82b2-0f2cf3b929af', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:10 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4363f47-ab20-490d-a09a-74cc374e4c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4363f47-ab20-490d-a09a-74cc374e4c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7b1663-4833-4b68-b17d-2fcfce887839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:10 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Volume c164da12-a9ea-4b94-82b2-0f2cf3b929af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c164da12-a9ea-4b94-82b2-0f2cf3b929af', 'volume_size': 1} Jul 03 01:26:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-160d93de-4940-4b21-9227-7a08f5637cf0 1073741824" returned: 0 in 1.631s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-160d93de-4940-4b21-9227-7a08f5637cf0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:10 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-160d93de-4940-4b21-9227-7a08f5637cf0 Jul 03 01:26:10 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:10 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:26:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Flow 'volume_create_manager' (a68ec15f-6636-448e-ae89-23eec0fbfd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffaf187b-7345-4cd4-9ffc-00dc0a0e24aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffaf187b-7345-4cd4-9ffc-00dc0a0e24aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-899435103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c956f47829f49b4845e2c7549a92338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:10Z,use_quota=True,user_id='c83bdb041be34915a5dd42f787a7f279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b0288f-fcc5-4a7c-9967-48e781b3e98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b0288f-fcc5-4a7c-9967-48e781b3e98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52f281c-ce2d-4357-9048-e26c85b00c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52f281c-ce2d-4357-9048-e26c85b00c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7', 'volume_name': 'volume-a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e1d53f-c9ee-41fe-be44-12bbf95d5213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e1d53f-c9ee-41fe-be44-12bbf95d5213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff074b4-b1cb-4943-a836-075d1e925b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:10 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Volume a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7', 'volume_size': 1} Jul 03 01:26:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:11 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-160d93de-4940-4b21-9227-7a08f5637cf0" returned: 0 in 0.826s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] <== create_volume: return (2526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:26:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.529s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.230s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-296279841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd5c8c17-bfda-48de-ae8e-92ac4cffcd66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d539b1dece4644adb55fcef6ee3858a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:09Z,use_quota=True,user_id='57326ac8ac444f7b89113fe37c762a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:26:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Creating volume bd5c8c17-bfda-48de-ae8e-92ac4cffcd66 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:26:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:26:11 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:26:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:11 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66 1073741824 Jul 03 01:26:11 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c03dc94-048d-404e-81a2-453ba45a600b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-160d93de-4940-4b21-9227-7a08f5637cf0', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (762b70f6-0763-442b-b2ee-203369c59980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:11 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Volume volume-160d93de-4940-4b21-9227-7a08f5637cf0 (160d93de-4940-4b21-9227-7a08f5637cf0): created successfully Jul 03 01:26:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (762b70f6-0763-442b-b2ee-203369c59980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Flow 'volume_create_manager' (6a709bdc-2066-4854-a63d-1ec718ce0c88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:11 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-adfe334d-89d6-442a-888b-6315de4811a5 tempest-CreateVolumesFromImageTest-568957811 None] Created volume successfully. Jul 03 01:26:11 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:26:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Flow 'volume_create_manager' (b2d18653-984e-4c84-b849-afba8a18ede6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7fa953f-11ea-48ea-ae3f-378f51ee2fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7fa953f-11ea-48ea-ae3f-378f51ee2fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5638836b-bf35-43bd-912c-970d96b203a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53da4aa6de474d7b9040c39cdd7be826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:12Z,use_quota=True,user_id='879f004050fd45f1bcc234ec44141122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ad7107-54c0-460a-8003-aeb3ce2b6082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ad7107-54c0-460a-8003-aeb3ce2b6082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f26020b2-6a03-4fbd-bf07-6bd51d483ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:11 devstack cinder-volume[86772]: DEBUG cinder.image.glance [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Creating Keystone auth plugin from conf {{(pid=86772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 01:26:12 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66 1073741824" returned: 0 in 0.978s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:12 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66 Jul 03 01:26:12 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f26020b2-6a03-4fbd-bf07-6bd51d483ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5638836b-bf35-43bd-912c-970d96b203a2', 'volume_name': 'volume-5638836b-bf35-43bd-912c-970d96b203a2', 'volume_size': 1, 'image_id': '33e42bf2-291b-4f99-a2a0-b65489fbaec0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33e42bf2-291b-4f99-a2a0-b65489fbaec0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c75e60600e9f879abdd7a7a30988ef92', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '53da4aa6de474d7b9040c39cdd7be826', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b1e6fe63d81831b21f79a1059d19b5f305a2c0f22a5d1fb3d61267e1528fb3cb1341206d064a8ea3aeabbf8579dc277d0a542502ad5b8fc5d009295a4074badb', 'id': '33e42bf2-291b-4f99-a2a0-b65489fbaec0', 'created_at': datetime.datetime(2026, 7, 2, 23, 26, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 26, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33e42bf2-291b-4f99-a2a0-b65489fbaec0/file', 'properties': {}}, 'image_service': }' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c598ed-11ae-4ebc-bb2d-22a696e04c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c598ed-11ae-4ebc-bb2d-22a696e04c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060978a7-e895-4685-a138-9ece4219c76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:12 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Volume 5638836b-bf35-43bd-912c-970d96b203a2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5638836b-bf35-43bd-912c-970d96b203a2', 'volume_size': 1, 'image_id': '33e42bf2-291b-4f99-a2a0-b65489fbaec0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33e42bf2-291b-4f99-a2a0-b65489fbaec0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c75e60600e9f879abdd7a7a30988ef92', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '53da4aa6de474d7b9040c39cdd7be826', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b1e6fe63d81831b21f79a1059d19b5f305a2c0f22a5d1fb3d61267e1528fb3cb1341206d064a8ea3aeabbf8579dc277d0a542502ad5b8fc5d009295a4074badb', 'id': '33e42bf2-291b-4f99-a2a0-b65489fbaec0', 'created_at': datetime.datetime(2026, 7, 2, 23, 26, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 26, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33e42bf2-291b-4f99-a2a0-b65489fbaec0/file', 'properties': {}}, 'image_service': } Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Trying to clone 5638836b-bf35-43bd-912c-970d96b203a2 from image 33e42bf2-291b-4f99-a2a0-b65489fbaec0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/33e42bf2-291b-4f99-a2a0-b65489fbaec0', 'metadata': {}}]). {{(pid=86772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_33e42bf2-291b-4f99-a2a0-b65489fbaec0_rw64wrqrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 01:26:12 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Image download 0.00 MB at 0.00 MB/s Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b4cdf8-1220-4efa-bc53-965779c01720]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33e42bf2-291b-4f99-a2a0-b65489fbaec0_rw64wrqrdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:12 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33e42bf2-291b-4f99-a2a0-b65489fbaec0_rw64wrqrdevstack@QuobyteHD Jul 03 01:26:12 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:12 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66" returned: 0 in 0.717s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.776s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1622376929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9315ea-b8df-43bd-a698-0bb0a6060997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c956f47829f49b4845e2c7549a92338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:09Z,use_quota=True,user_id='c83bdb041be34915a5dd42f787a7f279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Creating volume dd9315ea-b8df-43bd-a698-0bb0a6060997 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:26:12 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-dd9315ea-b8df-43bd-a698-0bb0a6060997 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:12 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-dd9315ea-b8df-43bd-a698-0bb0a6060997 1073741824 Jul 03 01:26:12 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f431b022-11dd-451b-a3cf-47335e7b46ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e757c0db-a584-4006-9109-f5be67fc7a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:12 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Volume volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66 (bd5c8c17-bfda-48de-ae8e-92ac4cffcd66): created successfully Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e757c0db-a584-4006-9109-f5be67fc7a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Flow 'volume_create_manager' (1915aaf6-dbda-49dd-9339-9107907bb153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:12 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:26:12 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:12 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5198efcd-436d-4784-9991-ae03121a36b7 tempest-CreateVolumesFromSnapshotTest-332290763 None] Created volume successfully. Jul 03 01:26:12 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:26:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Flow 'volume_create_manager' (ecfe7add-581d-48c9-8b9d-b4b1c50f3fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d523ef9e-2db1-45b1-bb47-7a56fd4f7f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d523ef9e-2db1-45b1-bb47-7a56fd4f7f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20642463-297c-4f68-a491-ef02b77f60ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a754306a15b424e8615890a4993b107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:13Z,use_quota=True,user_id='ff31815b26a449cc92ac1cc8b7922872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fb54cdd-17af-4079-993b-acfd69bb0b4e),volume_type_id=9fb54cdd-17af-4079-993b-acfd69bb0b4e)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f1d11d-7d6d-441d-a23e-7dd1962774a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f1d11d-7d6d-441d-a23e-7dd1962774a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca75c2df-8506-4eb2-9bce-cfb6989eab35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:13 devstack cinder-volume[86772]: DEBUG cinder.image.glance [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Creating Keystone auth plugin from conf {{(pid=86772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 03 01:26:13 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33e42bf2-291b-4f99-a2a0-b65489fbaec0_rw64wrqrdevstack@QuobyteHD" returned: 0 in 0.870s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33e42bf2-291b-4f99-a2a0-b65489fbaec0_rw64wrqrdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca75c2df-8506-4eb2-9bce-cfb6989eab35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '20642463-297c-4f68-a491-ef02b77f60ae', 'volume_name': 'volume-20642463-297c-4f68-a491-ef02b77f60ae', 'volume_size': 1, 'image_id': 'e2a959db-f614-4f72-8594-ef9cfe13e75e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2a959db-f614-4f72-8594-ef9cfe13e75e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '94fbbd1f06b5eb8ff172117903187ba1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9a754306a15b424e8615890a4993b107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'adf33f23035fecdd73597747b22b61be77a176fe7ff5b9227b1400be61c7a8e7180f89fa33f6160a10f50179564866cd0121af5820cbdb5b96c3ba06ef3f7606', 'id': 'e2a959db-f614-4f72-8594-ef9cfe13e75e', 'created_at': datetime.datetime(2026, 7, 2, 23, 26, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 26, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2a959db-f614-4f72-8594-ef9cfe13e75e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b0374b7-bd3e-4e54-8833-1882cd84e576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b0374b7-bd3e-4e54-8833-1882cd84e576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0357d0af-d05f-41be-a53a-d84029a4dc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:13 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Volume 20642463-297c-4f68-a491-ef02b77f60ae: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-20642463-297c-4f68-a491-ef02b77f60ae', 'volume_size': 1, 'image_id': 'e2a959db-f614-4f72-8594-ef9cfe13e75e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2a959db-f614-4f72-8594-ef9cfe13e75e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '94fbbd1f06b5eb8ff172117903187ba1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9a754306a15b424e8615890a4993b107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'adf33f23035fecdd73597747b22b61be77a176fe7ff5b9227b1400be61c7a8e7180f89fa33f6160a10f50179564866cd0121af5820cbdb5b96c3ba06ef3f7606', 'id': 'e2a959db-f614-4f72-8594-ef9cfe13e75e', 'created_at': datetime.datetime(2026, 7, 2, 23, 26, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 26, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2a959db-f614-4f72-8594-ef9cfe13e75e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 03 01:26:13 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Trying to clone 20642463-297c-4f68-a491-ef02b77f60ae from image e2a959db-f614-4f72-8594-ef9cfe13e75e at location (None, [{'url': 'file:///opt/stack/data/glance/images/e2a959db-f614-4f72-8594-ef9cfe13e75e', 'metadata': {}}]). {{(pid=86772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 03 01:26:13 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33e42bf2-291b-4f99-a2a0-b65489fbaec0_rw64wrqrdevstack@QuobyteHD Jul 03 01:26:13 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:13 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e2a959db-f614-4f72-8594-ef9cfe13e75e_nbto8uupdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 03 01:26:13 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Image download 0.00 MB at 0.00 MB/s Jul 03 01:26:13 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7afda0e-863e-426c-a258-1965aae0cad6]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a959db-f614-4f72-8594-ef9cfe13e75e_nbto8uupdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:13 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a959db-f614-4f72-8594-ef9cfe13e75e_nbto8uupdevstack@QuobyteHD Jul 03 01:26:13 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:13 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.839s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:26:13 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:26:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 29 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:26:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:26:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-24e80f44-2ccb-4a1f-bd0f-9e447e76a064 tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:13 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-dd9315ea-b8df-43bd-a698-0bb0a6060997 1073741824" returned: 0 in 1.175s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-dd9315ea-b8df-43bd-a698-0bb0a6060997 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:14 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-dd9315ea-b8df-43bd-a698-0bb0a6060997 Jul 03 01:26:14 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:14 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33e42bf2-291b-4f99-a2a0-b65489fbaec0_rw64wrqrdevstack@QuobyteHD" returned: 1 in 0.963s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33e42bf2-291b-4f99-a2a0-b65489fbaec0_rw64wrqrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:26:14 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Temporary image 33e42bf2-291b-4f99-a2a0-b65489fbaec0 is fetched for user 879f004050fd45f1bcc234ec44141122. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 01:26:14 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a767e8a-f94d-44e4-9d25-54e4af4ac5fe]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33e42bf2-291b-4f99-a2a0-b65489fbaec0_rw64wrqrdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:14 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a959db-f614-4f72-8594-ef9cfe13e75e_nbto8uupdevstack@QuobyteHD" returned: 0 in 0.834s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a959db-f614-4f72-8594-ef9cfe13e75e_nbto8uupdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:14 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33e42bf2-291b-4f99-a2a0-b65489fbaec0_rw64wrqrdevstack@QuobyteHD Jul 03 01:26:14 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:14 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a959db-f614-4f72-8594-ef9cfe13e75e_nbto8uupdevstack@QuobyteHD Jul 03 01:26:14 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:14 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-dd9315ea-b8df-43bd-a698-0bb0a6060997" returned: 0 in 0.702s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] <== create_volume: return (1920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:26:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.923s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-155687353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f30c961-2eb7-4d95-9e4b-240b61bcf146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c956f47829f49b4845e2c7549a92338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:09Z,use_quota=True,user_id='c83bdb041be34915a5dd42f787a7f279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:26:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Creating volume 2f30c961-2eb7-4d95-9e4b-240b61bcf146 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:26:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:14 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:26:14 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:26:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2f30c961-2eb7-4d95-9e4b-240b61bcf146 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11408e6a-d4fb-451e-aae3-3885a1ea8829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd9315ea-b8df-43bd-a698-0bb0a6060997', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:14 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2f30c961-2eb7-4d95-9e4b-240b61bcf146 1073741824 Jul 03 01:26:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9fe400e-2ccf-4171-8626-b86f9da1cb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:14 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:14 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Volume volume-dd9315ea-b8df-43bd-a698-0bb0a6060997 (dd9315ea-b8df-43bd-a698-0bb0a6060997): created successfully Jul 03 01:26:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9fe400e-2ccf-4171-8626-b86f9da1cb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Flow 'volume_create_manager' (9712b391-0512-4551-a772-f899b0ab4f55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:14 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b0b6457e-3c9e-43c5-b441-a396aa71db60 tempest-CreateVolumesFromImageTest-568957811 None] Created volume successfully. Jul 03 01:26:15 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33e42bf2-291b-4f99-a2a0-b65489fbaec0_rw64wrqrdevstack@QuobyteHD" returned: 0 in 0.822s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33e42bf2-291b-4f99-a2a0-b65489fbaec0_rw64wrqrdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:15 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a959db-f614-4f72-8594-ef9cfe13e75e_nbto8uupdevstack@QuobyteHD" returned: 1 in 0.783s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a959db-f614-4f72-8594-ef9cfe13e75e_nbto8uupdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:26:15 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Temporary image e2a959db-f614-4f72-8594-ef9cfe13e75e is fetched for user ff31815b26a449cc92ac1cc8b7922872. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 03 01:26:15 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[894fd70c-8316-48c8-a1fd-f1edd0c67495]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a959db-f614-4f72-8594-ef9cfe13e75e_nbto8uupdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:15 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33e42bf2-291b-4f99-a2a0-b65489fbaec0_rw64wrqrdevstack@QuobyteHD Jul 03 01:26:15 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:15 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a959db-f614-4f72-8594-ef9cfe13e75e_nbto8uupdevstack@QuobyteHD Jul 03 01:26:15 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:15 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2f30c961-2eb7-4d95-9e4b-240b61bcf146 1073741824" returned: 0 in 0.994s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2f30c961-2eb7-4d95-9e4b-240b61bcf146 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:15 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2f30c961-2eb7-4d95-9e4b-240b61bcf146 Jul 03 01:26:15 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:15 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33e42bf2-291b-4f99-a2a0-b65489fbaec0_rw64wrqrdevstack@QuobyteHD" returned: 1 in 0.809s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33e42bf2-291b-4f99-a2a0-b65489fbaec0_rw64wrqrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:26:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:16 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a959db-f614-4f72-8594-ef9cfe13e75e_nbto8uupdevstack@QuobyteHD" returned: 0 in 0.844s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a959db-f614-4f72-8594-ef9cfe13e75e_nbto8uupdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:16 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a959db-f614-4f72-8594-ef9cfe13e75e_nbto8uupdevstack@QuobyteHD Jul 03 01:26:16 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:16 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2f30c961-2eb7-4d95-9e4b-240b61bcf146" returned: 0 in 0.644s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:26:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.255s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1790809107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c164da12-a9ea-4b94-82b2-0f2cf3b929af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c956f47829f49b4845e2c7549a92338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:10Z,use_quota=True,user_id='c83bdb041be34915a5dd42f787a7f279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:26:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Creating volume c164da12-a9ea-4b94-82b2-0f2cf3b929af {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:26:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:26:16 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:26:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c164da12-a9ea-4b94-82b2-0f2cf3b929af 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2bc5143-ba30-4d5c-9b0d-6f3aeaf6493f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f30c961-2eb7-4d95-9e4b-240b61bcf146', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:16 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c164da12-a9ea-4b94-82b2-0f2cf3b929af 1073741824 Jul 03 01:26:16 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2ff22d-fd7d-4561-903e-ffafde385533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:16 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Volume volume-2f30c961-2eb7-4d95-9e4b-240b61bcf146 (2f30c961-2eb7-4d95-9e4b-240b61bcf146): created successfully Jul 03 01:26:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2ff22d-fd7d-4561-903e-ffafde385533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Flow 'volume_create_manager' (65520715-7211-48ad-9b3c-aa8342fff2b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:16 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-abff937d-f5dd-4d54-9b6b-9023790d0787 tempest-CreateVolumesFromImageTest-568957811 None] Created volume successfully. Jul 03 01:26:16 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a959db-f614-4f72-8594-ef9cfe13e75e_nbto8uupdevstack@QuobyteHD" returned: 1 in 0.757s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a959db-f614-4f72-8594-ef9cfe13e75e_nbto8uupdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:26:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:17 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c164da12-a9ea-4b94-82b2-0f2cf3b929af 1073741824" returned: 0 in 0.862s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c164da12-a9ea-4b94-82b2-0f2cf3b929af {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:17 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c164da12-a9ea-4b94-82b2-0f2cf3b929af Jul 03 01:26:17 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:18 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c164da12-a9ea-4b94-82b2-0f2cf3b929af" returned: 0 in 0.667s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:26:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.482s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-899435103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c956f47829f49b4845e2c7549a92338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:10Z,use_quota=True,user_id='c83bdb041be34915a5dd42f787a7f279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:26:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Creating volume a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:26:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:26:18 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:26:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:18 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7 1073741824 Jul 03 01:26:18 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7b1663-4833-4b68-b17d-2fcfce887839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c164da12-a9ea-4b94-82b2-0f2cf3b929af', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feb6a176-e3b2-483f-96a5-a1d4c5d606bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:18 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Volume volume-c164da12-a9ea-4b94-82b2-0f2cf3b929af (c164da12-a9ea-4b94-82b2-0f2cf3b929af): created successfully Jul 03 01:26:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feb6a176-e3b2-483f-96a5-a1d4c5d606bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Flow 'volume_create_manager' (bb244cd7-9857-4f0d-845d-e8a636708c6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:18 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c5fdb2b8-e022-4b58-a0c6-23f14123693b tempest-CreateVolumesFromImageTest-568957811 None] Created volume successfully. Jul 03 01:26:18 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7 1073741824" returned: 0 in 0.856s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:18 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7 Jul 03 01:26:18 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:19 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7" returned: 0 in 0.660s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:26:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-24e80f44-2ccb-4a1f-bd0f-9e447e76a064 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.624s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff074b4-b1cb-4943-a836-075d1e925b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e6d082-990d-40a1-84ac-fe7aa65e86f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-24e80f44-2ccb-4a1f-bd0f-9e447e76a064 tempest-CreateVolumesFromSnapshotTest-332290763 None] Creating offline snapshot 895ada74-e324-41b8-a70a-d529f7bee574 of volume bd5c8c17-bfda-48de-ae8e-92ac4cffcd66 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:26:19 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Volume volume-a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7 (a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7): created successfully Jul 03 01:26:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e6d082-990d-40a1-84ac-fe7aa65e86f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Flow 'volume_create_manager' (a68ec15f-6636-448e-ae89-23eec0fbfd3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:19 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c84e2b-76f5-47d3-8c1f-80975253e58e]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24e80f44-2ccb-4a1f-bd0f-9e447e76a064 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:19 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-03aed38a-a055-416c-a6fe-5633ae38f596 tempest-CreateVolumesFromImageTest-568957811 None] Created volume successfully. Jul 03 01:26:19 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66 Jul 03 01:26:19 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-011cec58-6a4d-4fdc-962b-a4d74636bee2 tempest-CreateVolumesFromImageTest-568957811 None] Acquiring lock "cinder-a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-011cec58-6a4d-4fdc-962b-a4d74636bee2 tempest-CreateVolumesFromImageTest-568957811 None] Lock "cinder-a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-011cec58-6a4d-4fdc-962b-a4d74636bee2 tempest-CreateVolumesFromImageTest-568957811 None] Acquiring lock "cinder-quobyte-a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:20 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-011cec58-6a4d-4fdc-962b-a4d74636bee2 tempest-CreateVolumesFromImageTest-568957811 None] Lock "cinder-quobyte-a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7" acquired by "delete_volume" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:20 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbcc38d-f351-437e-87f4-3362c7d90082]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-011cec58-6a4d-4fdc-962b-a4d74636bee2 tempest-CreateVolumesFromImageTest-568957811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:20 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7 Jul 03 01:26:20 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:20 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24e80f44-2ccb-4a1f-bd0f-9e447e76a064 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66" returned: 0 in 0.793s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24e80f44-2ccb-4a1f-bd0f-9e447e76a064 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.895ada74-e324-41b8-a70a-d529f7bee574 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:20 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.895ada74-e324-41b8-a70a-d529f7bee574 1G Jul 03 01:26:20 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:21 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-011cec58-6a4d-4fdc-962b-a4d74636bee2 tempest-CreateVolumesFromImageTest-568957811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7" returned: 0 in 0.751s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-011cec58-6a4d-4fdc-962b-a4d74636bee2 tempest-CreateVolumesFromImageTest-568957811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:21 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7 Jul 03 01:26:21 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24e80f44-2ccb-4a1f-bd0f-9e447e76a064 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.895ada74-e324-41b8-a70a-d529f7bee574 1G" returned: 0 in 0.764s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:21 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24e80f44-2ccb-4a1f-bd0f-9e447e76a064 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.895ada74-e324-41b8-a70a-d529f7bee574 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:21 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.895ada74-e324-41b8-a70a-d529f7bee574 Jul 03 01:26:21 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:21 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-011cec58-6a4d-4fdc-962b-a4d74636bee2 tempest-CreateVolumesFromImageTest-568957811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7" returned: 0 in 0.670s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-011cec58-6a4d-4fdc-962b-a4d74636bee2 tempest-CreateVolumesFromImageTest-568957811 None] Lock "cinder-quobyte-a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7" released by "delete_volume" :: held 1.465s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:21 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-011cec58-6a4d-4fdc-962b-a4d74636bee2 tempest-CreateVolumesFromImageTest-568957811 None] Created reservations ['7a2ac14f-f944-4474-bd9a-0e5f80a74f64', '33105587-f4a4-4736-bcb9-372fcd65a9d7', 'f92177e1-dfaf-44b5-b973-0e3db63e6733', 'd568cae2-9b4d-45a3-9277-11c170f41dbd'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:26:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-011cec58-6a4d-4fdc-962b-a4d74636bee2 tempest-CreateVolumesFromImageTest-568957811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-011cec58-6a4d-4fdc-962b-a4d74636bee2 tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-011cec58-6a4d-4fdc-962b-a4d74636bee2 tempest-CreateVolumesFromImageTest-568957811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:21 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-011cec58-6a4d-4fdc-962b-a4d74636bee2 tempest-CreateVolumesFromImageTest-568957811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-011cec58-6a4d-4fdc-962b-a4d74636bee2 tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-011cec58-6a4d-4fdc-962b-a4d74636bee2 tempest-CreateVolumesFromImageTest-568957811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:21 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24e80f44-2ccb-4a1f-bd0f-9e447e76a064 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.895ada74-e324-41b8-a70a-d529f7bee574" returned: 0 in 0.722s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:21 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-24e80f44-2ccb-4a1f-bd0f-9e447e76a064 tempest-CreateVolumesFromSnapshotTest-332290763 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.895ada74-e324-41b8-a70a-d529f7bee574 is being set with open permissions: ugo+rw Jul 03 01:26:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24e80f44-2ccb-4a1f-bd0f-9e447e76a064 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.895ada74-e324-41b8-a70a-d529f7bee574 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:21 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:26:21 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:21 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.895ada74-e324-41b8-a70a-d529f7bee574 Jul 03 01:26:21 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-559d0f88-820a-4d5e-8b07-9d925e44b38c tempest-CreateVolumesFromImageTest-568957811 None] Acquiring lock "cinder-c164da12-a9ea-4b94-82b2-0f2cf3b929af-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-559d0f88-820a-4d5e-8b07-9d925e44b38c tempest-CreateVolumesFromImageTest-568957811 None] Lock "cinder-c164da12-a9ea-4b94-82b2-0f2cf3b929af-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-559d0f88-820a-4d5e-8b07-9d925e44b38c tempest-CreateVolumesFromImageTest-568957811 None] Acquiring lock "cinder-quobyte-c164da12-a9ea-4b94-82b2-0f2cf3b929af" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:22 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24e80f44-2ccb-4a1f-bd0f-9e447e76a064 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.895ada74-e324-41b8-a70a-d529f7bee574" returned: 0 in 0.656s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-559d0f88-820a-4d5e-8b07-9d925e44b38c tempest-CreateVolumesFromImageTest-568957811 None] Lock "cinder-quobyte-c164da12-a9ea-4b94-82b2-0f2cf3b929af" acquired by "delete_volume" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:22 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-011cec58-6a4d-4fdc-962b-a4d74636bee2 tempest-CreateVolumesFromImageTest-568957811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.715s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:22 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-011cec58-6a4d-4fdc-962b-a4d74636bee2 tempest-CreateVolumesFromImageTest-568957811 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:26:22 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-011cec58-6a4d-4fdc-962b-a4d74636bee2 tempest-CreateVolumesFromImageTest-568957811 None] Deleted volume successfully. Jul 03 01:26:22 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff86a93-4b93-42fc-a675-e37ea1bbc5b7]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-559d0f88-820a-4d5e-8b07-9d925e44b38c tempest-CreateVolumesFromImageTest-568957811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c164da12-a9ea-4b94-82b2-0f2cf3b929af {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24e80f44-2ccb-4a1f-bd0f-9e447e76a064 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-011cec58-6a4d-4fdc-962b-a4d74636bee2 tempest-CreateVolumesFromImageTest-568957811 None] Lock "cinder-a67fd8bc-03c5-46a3-b6c1-937cbc21c3c7-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:22 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.info Jul 03 01:26:22 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:22 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c164da12-a9ea-4b94-82b2-0f2cf3b929af Jul 03 01:26:22 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:23 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24e80f44-2ccb-4a1f-bd0f-9e447e76a064 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.info" returned: 0 in 0.700s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:23 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-24e80f44-2ccb-4a1f-bd0f-9e447e76a064 tempest-CreateVolumesFromSnapshotTest-332290763 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.info is being set with open permissions: ugo+rw Jul 03 01:26:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24e80f44-2ccb-4a1f-bd0f-9e447e76a064 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:23 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.info Jul 03 01:26:23 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:23 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-559d0f88-820a-4d5e-8b07-9d925e44b38c tempest-CreateVolumesFromImageTest-568957811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c164da12-a9ea-4b94-82b2-0f2cf3b929af" returned: 0 in 0.790s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-559d0f88-820a-4d5e-8b07-9d925e44b38c tempest-CreateVolumesFromImageTest-568957811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c164da12-a9ea-4b94-82b2-0f2cf3b929af {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:23 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c164da12-a9ea-4b94-82b2-0f2cf3b929af Jul 03 01:26:23 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:24 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-24e80f44-2ccb-4a1f-bd0f-9e447e76a064 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.info" returned: 0 in 0.683s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-24e80f44-2ccb-4a1f-bd0f-9e447e76a064 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.484s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.138s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5638836b-bf35-43bd-912c-970d96b203a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53da4aa6de474d7b9040c39cdd7be826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:12Z,use_quota=True,user_id='879f004050fd45f1bcc234ec44141122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Creating volume 5638836b-bf35-43bd-912c-970d96b203a2 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:26:24 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:24 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2 1073741824 Jul 03 01:26:24 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:24 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-24e80f44-2ccb-4a1f-bd0f-9e447e76a064 tempest-CreateVolumesFromSnapshotTest-332290763 None] Create snapshot completed successfully Jul 03 01:26:24 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-559d0f88-820a-4d5e-8b07-9d925e44b38c tempest-CreateVolumesFromImageTest-568957811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c164da12-a9ea-4b94-82b2-0f2cf3b929af" returned: 0 in 0.751s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-559d0f88-820a-4d5e-8b07-9d925e44b38c tempest-CreateVolumesFromImageTest-568957811 None] Lock "cinder-quobyte-c164da12-a9ea-4b94-82b2-0f2cf3b929af" released by "delete_volume" :: held 1.589s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-559d0f88-820a-4d5e-8b07-9d925e44b38c tempest-CreateVolumesFromImageTest-568957811 None] Created reservations ['721763cf-728a-4673-980d-012ea2116e7a', '8c2d6e61-df16-470c-9a1c-b3f661da9642', 'e04482d1-fe2a-4f04-af75-6401f64c8953', 'd0a1b653-670f-4332-95a5-7dacc1c688cb'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-559d0f88-820a-4d5e-8b07-9d925e44b38c tempest-CreateVolumesFromImageTest-568957811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-559d0f88-820a-4d5e-8b07-9d925e44b38c tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-559d0f88-820a-4d5e-8b07-9d925e44b38c tempest-CreateVolumesFromImageTest-568957811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-559d0f88-820a-4d5e-8b07-9d925e44b38c tempest-CreateVolumesFromImageTest-568957811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-559d0f88-820a-4d5e-8b07-9d925e44b38c tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-559d0f88-820a-4d5e-8b07-9d925e44b38c tempest-CreateVolumesFromImageTest-568957811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:24 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:26:24 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-82c9ee0a-2038-4c7c-8e7c-b805f206eb98 tempest-CreateVolumesFromImageTest-568957811 None] Acquiring lock "cinder-2f30c961-2eb7-4d95-9e4b-240b61bcf146-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-82c9ee0a-2038-4c7c-8e7c-b805f206eb98 tempest-CreateVolumesFromImageTest-568957811 None] Lock "cinder-2f30c961-2eb7-4d95-9e4b-240b61bcf146-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-82c9ee0a-2038-4c7c-8e7c-b805f206eb98 tempest-CreateVolumesFromImageTest-568957811 None] Acquiring lock "cinder-quobyte-2f30c961-2eb7-4d95-9e4b-240b61bcf146" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-82c9ee0a-2038-4c7c-8e7c-b805f206eb98 tempest-CreateVolumesFromImageTest-568957811 None] Lock "cinder-quobyte-2f30c961-2eb7-4d95-9e4b-240b61bcf146" acquired by "delete_volume" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e17cfe2-a43d-4335-af8b-54dcac8abfdc]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-82c9ee0a-2038-4c7c-8e7c-b805f206eb98 tempest-CreateVolumesFromImageTest-568957811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2f30c961-2eb7-4d95-9e4b-240b61bcf146 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Flow 'volume_create_manager' (d9c08457-3eba-4eba-a542-934928712ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6569bc24-ff25-445e-ad6d-c726828f0da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6569bc24-ff25-445e-ad6d-c726828f0da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-701370043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d539b1dece4644adb55fcef6ee3858a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:25Z,use_quota=True,user_id='57326ac8ac444f7b89113fe37c762a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a4ad7d-8c49-4290-9115-01d42259dd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a4ad7d-8c49-4290-9115-01d42259dd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd7f0eea-583e-4843-8f77-d4e9abaed6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd7f0eea-583e-4843-8f77-d4e9abaed6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9', 'volume_name': 'volume-7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4144072-79d2-4d13-b486-e5e17eeb83e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:25 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4144072-79d2-4d13-b486-e5e17eeb83e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b168e48b-446e-4f7e-bafb-bfc0444b7dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:25 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Volume 7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9', 'volume_size': 1} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2 1073741824" returned: 0 in 1.028s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:25 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-559d0f88-820a-4d5e-8b07-9d925e44b38c tempest-CreateVolumesFromImageTest-568957811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.842s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-559d0f88-820a-4d5e-8b07-9d925e44b38c tempest-CreateVolumesFromImageTest-568957811 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:26:25 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-559d0f88-820a-4d5e-8b07-9d925e44b38c tempest-CreateVolumesFromImageTest-568957811 None] Deleted volume successfully. Jul 03 01:26:25 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2f30c961-2eb7-4d95-9e4b-240b61bcf146 Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:25 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-559d0f88-820a-4d5e-8b07-9d925e44b38c tempest-CreateVolumesFromImageTest-568957811 None] Lock "cinder-c164da12-a9ea-4b94-82b2-0f2cf3b929af-delete_volume" released by "delete_volume" :: held 2.673s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:25 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2 Jul 03 01:26:25 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Flow 'volume_create_manager' (eaf0054d-6629-4759-9c6d-410e54d921a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f743ae-5328-4825-8960-80efa2867943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f743ae-5328-4825-8960-80efa2867943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-536058843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bebff1ee-10b9-49b2-95e7-058f0e7dfd91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d539b1dece4644adb55fcef6ee3858a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:25Z,use_quota=True,user_id='57326ac8ac444f7b89113fe37c762a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc851f6a-3358-4556-a0bc-46e75c828ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc851f6a-3358-4556-a0bc-46e75c828ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e462382c-f683-4f23-9b33-ab72c0f77fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e462382c-f683-4f23-9b33-ab72c0f77fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bebff1ee-10b9-49b2-95e7-058f0e7dfd91', 'volume_name': 'volume-bebff1ee-10b9-49b2-95e7-058f0e7dfd91', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9273cb86-39a4-4f86-835d-3c6800494337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9273cb86-39a4-4f86-835d-3c6800494337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e456960-5652-481e-a0d5-de2da353a2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:25 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Volume bebff1ee-10b9-49b2-95e7-058f0e7dfd91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bebff1ee-10b9-49b2-95e7-058f0e7dfd91', 'volume_size': 1} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:25 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2" returned: 0 in 0.790s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.117s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20642463-297c-4f68-a491-ef02b77f60ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a754306a15b424e8615890a4993b107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:13Z,use_quota=True,user_id='ff31815b26a449cc92ac1cc8b7922872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fb54cdd-17af-4079-993b-acfd69bb0b4e),volume_type_id=9fb54cdd-17af-4079-993b-acfd69bb0b4e)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Creating volume 20642463-297c-4f68-a491-ef02b77f60ae {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:26:25 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:26:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:26 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:26 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae 1073741824 Jul 03 01:26:26 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-82c9ee0a-2038-4c7c-8e7c-b805f206eb98 tempest-CreateVolumesFromImageTest-568957811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2f30c961-2eb7-4d95-9e4b-240b61bcf146" returned: 0 in 1.088s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-82c9ee0a-2038-4c7c-8e7c-b805f206eb98 tempest-CreateVolumesFromImageTest-568957811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2f30c961-2eb7-4d95-9e4b-240b61bcf146 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Attempting download of 33e42bf2-291b-4f99-a2a0-b65489fbaec0 ((None, [{'url': 'file:///opt/stack/data/glance/images/33e42bf2-291b-4f99-a2a0-b65489fbaec0', 'metadata': {}}])) to volume 5638836b-bf35-43bd-912c-970d96b203a2. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:26:26 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2f30c961-2eb7-4d95-9e4b-240b61bcf146 Jul 03 01:26:26 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Flow 'volume_create_manager' (cbf467ae-6f12-4d0d-ad2e-51d4a4c55c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4df637f-b7e1-485b-81f8-46f3e809a33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4df637f-b7e1-485b-81f8-46f3e809a33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-721684525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=046042d3-64e2-481f-9ff9-d7cefd3e4dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d539b1dece4644adb55fcef6ee3858a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:26Z,use_quota=True,user_id='57326ac8ac444f7b89113fe37c762a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf53d2f-a77b-43d9-8190-aa123405df38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf53d2f-a77b-43d9-8190-aa123405df38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba430e9b-10d1-4939-a821-5a7c0372352e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba430e9b-10d1-4939-a821-5a7c0372352e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '046042d3-64e2-481f-9ff9-d7cefd3e4dbe', 'volume_name': 'volume-046042d3-64e2-481f-9ff9-d7cefd3e4dbe', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec5e724-28a9-425c-9e71-ccb0c316ae5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec5e724-28a9-425c-9e71-ccb0c316ae5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc60ecd-7634-47d0-a213-b66b86174c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:26 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Volume 046042d3-64e2-481f-9ff9-d7cefd3e4dbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-046042d3-64e2-481f-9ff9-d7cefd3e4dbe', 'volume_size': 1} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[36728a8b-a492-4abb-af41-bd40449ad9d2]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33e42bf2-291b-4f99-a2a0-b65489fbaec0_8gh3uagr {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:26 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33e42bf2-291b-4f99-a2a0-b65489fbaec0_8gh3uagr Jul 03 01:26:26 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Flow 'volume_create_manager' (4b794ff6-1a0a-4199-bf9f-05d002583ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48c74d6-c5d5-499c-8490-5b2f47eb5e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48c74d6-c5d5-499c-8490-5b2f47eb5e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-473433686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5468ce3e-d29f-4f10-844e-770a12e71468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d539b1dece4644adb55fcef6ee3858a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:26Z,use_quota=True,user_id='57326ac8ac444f7b89113fe37c762a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f430cf85-2eab-422a-93d8-ebf6303e4498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f430cf85-2eab-422a-93d8-ebf6303e4498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd75db5c-4fba-4776-97f9-b53ec99f4f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd75db5c-4fba-4776-97f9-b53ec99f4f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5468ce3e-d29f-4f10-844e-770a12e71468', 'volume_name': 'volume-5468ce3e-d29f-4f10-844e-770a12e71468', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c157347-b119-4ea3-b0ef-c66e5098a1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c157347-b119-4ea3-b0ef-c66e5098a1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4315e9bd-e542-4867-b471-287a685a463a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:26 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Volume 5468ce3e-d29f-4f10-844e-770a12e71468: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5468ce3e-d29f-4f10-844e-770a12e71468', 'volume_size': 1} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:26 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-82c9ee0a-2038-4c7c-8e7c-b805f206eb98 tempest-CreateVolumesFromImageTest-568957811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2f30c961-2eb7-4d95-9e4b-240b61bcf146" returned: 0 in 0.914s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-82c9ee0a-2038-4c7c-8e7c-b805f206eb98 tempest-CreateVolumesFromImageTest-568957811 None] Lock "cinder-quobyte-2f30c961-2eb7-4d95-9e4b-240b61bcf146" released by "delete_volume" :: held 2.072s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Flow 'volume_create_manager' (ddec8308-4b64-49b1-8bec-a8183049ac4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28966f86-4d01-4dc8-909a-bacf37f325f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-82c9ee0a-2038-4c7c-8e7c-b805f206eb98 tempest-CreateVolumesFromImageTest-568957811 None] Created reservations ['703683f7-c224-4d76-a1eb-f4a030a3a74e', '2840c040-29f0-4d48-94c3-4aa66a3cd469', 'd402dd5e-ecf2-44b9-94cb-7e4e2a1f851c', '50032ccc-bf41-446a-ab46-b9f1f45b6516'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28966f86-4d01-4dc8-909a-bacf37f325f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-591915405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5353826b-a438-45bf-a3a8-85870b3cdef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d539b1dece4644adb55fcef6ee3858a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:27Z,use_quota=True,user_id='57326ac8ac444f7b89113fe37c762a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b844846c-1be9-4e06-8300-00381258f369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b844846c-1be9-4e06-8300-00381258f369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f85cdd8-8330-42e8-bf4b-c214f28a7c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f85cdd8-8330-42e8-bf4b-c214f28a7c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5353826b-a438-45bf-a3a8-85870b3cdef2', 'volume_name': 'volume-5353826b-a438-45bf-a3a8-85870b3cdef2', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:27 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c09ea619-0398-42dd-ad06-2fb75d6ae051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c09ea619-0398-42dd-ad06-2fb75d6ae051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f1514c-7943-4c6f-9b44-266c1bb8abac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:27 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Volume 5353826b-a438-45bf-a3a8-85870b3cdef2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5353826b-a438-45bf-a3a8-85870b3cdef2', 'volume_size': 1} Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:27 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae 1073741824" returned: 0 in 1.195s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33e42bf2-291b-4f99-a2a0-b65489fbaec0_8gh3uagr" returned: 0 in 0.983s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33e42bf2-291b-4f99-a2a0-b65489fbaec0_8gh3uagr {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-82c9ee0a-2038-4c7c-8e7c-b805f206eb98 tempest-CreateVolumesFromImageTest-568957811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-82c9ee0a-2038-4c7c-8e7c-b805f206eb98 tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-82c9ee0a-2038-4c7c-8e7c-b805f206eb98 tempest-CreateVolumesFromImageTest-568957811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:27 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae Jul 03 01:26:27 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-82c9ee0a-2038-4c7c-8e7c-b805f206eb98 tempest-CreateVolumesFromImageTest-568957811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-82c9ee0a-2038-4c7c-8e7c-b805f206eb98 tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-82c9ee0a-2038-4c7c-8e7c-b805f206eb98 tempest-CreateVolumesFromImageTest-568957811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:27 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33e42bf2-291b-4f99-a2a0-b65489fbaec0_8gh3uagr Jul 03 01:26:27 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:27 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:26:27 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:27 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-82c9ee0a-2038-4c7c-8e7c-b805f206eb98 tempest-CreateVolumesFromImageTest-568957811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.705s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-82c9ee0a-2038-4c7c-8e7c-b805f206eb98 tempest-CreateVolumesFromImageTest-568957811 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:26:27 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:27 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-82c9ee0a-2038-4c7c-8e7c-b805f206eb98 tempest-CreateVolumesFromImageTest-568957811 None] Deleted volume successfully. Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae" returned: 0 in 0.757s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] <== create_volume: return (2036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.041s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.898s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-701370043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d539b1dece4644adb55fcef6ee3858a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:25Z,use_quota=True,user_id='57326ac8ac444f7b89113fe37c762a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Creating volume 7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:26:28 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-82c9ee0a-2038-4c7c-8e7c-b805f206eb98 tempest-CreateVolumesFromImageTest-568957811 None] Lock "cinder-2f30c961-2eb7-4d95-9e4b-240b61bcf146-delete_volume" released by "delete_volume" :: held 3.233s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:28 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9 1073741824 Jul 03 01:26:28 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:28 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33e42bf2-291b-4f99-a2a0-b65489fbaec0_8gh3uagr" returned: 1 in 0.866s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33e42bf2-291b-4f99-a2a0-b65489fbaec0_8gh3uagr' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[291cfa8e-4f58-4d47-9107-9d24a18e3eaa]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33e42bf2-291b-4f99-a2a0-b65489fbaec0_rw64wrqrdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Attempting download of e2a959db-f614-4f72-8594-ef9cfe13e75e ((None, [{'url': 'file:///opt/stack/data/glance/images/e2a959db-f614-4f72-8594-ef9cfe13e75e', 'metadata': {}}])) to volume 20642463-297c-4f68-a491-ef02b77f60ae. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfb007d-8475-491f-83d0-878110c9dd04]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2a959db-f614-4f72-8594-ef9cfe13e75e_aeb2q09n {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:28 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33e42bf2-291b-4f99-a2a0-b65489fbaec0_rw64wrqrdevstack@QuobyteHD Jul 03 01:26:28 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c6230d9-04f9-4239-9dc0-aaaed9d8db49 tempest-CreateVolumesFromImageTest-568957811 None] Acquiring lock "cinder-dd9315ea-b8df-43bd-a698-0bb0a6060997-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c6230d9-04f9-4239-9dc0-aaaed9d8db49 tempest-CreateVolumesFromImageTest-568957811 None] Lock "cinder-dd9315ea-b8df-43bd-a698-0bb0a6060997-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c6230d9-04f9-4239-9dc0-aaaed9d8db49 tempest-CreateVolumesFromImageTest-568957811 None] Acquiring lock "cinder-quobyte-dd9315ea-b8df-43bd-a698-0bb0a6060997" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:28 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2a959db-f614-4f72-8594-ef9cfe13e75e_aeb2q09n Jul 03 01:26:28 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c6230d9-04f9-4239-9dc0-aaaed9d8db49 tempest-CreateVolumesFromImageTest-568957811 None] Lock "cinder-quobyte-dd9315ea-b8df-43bd-a698-0bb0a6060997" acquired by "delete_volume" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[232eb6af-dcad-432b-802f-89ccf1d0ee8c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c6230d9-04f9-4239-9dc0-aaaed9d8db49 tempest-CreateVolumesFromImageTest-568957811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-dd9315ea-b8df-43bd-a698-0bb0a6060997 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:28 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-dd9315ea-b8df-43bd-a698-0bb0a6060997 Jul 03 01:26:28 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:28 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33e42bf2-291b-4f99-a2a0-b65489fbaec0_rw64wrqrdevstack@QuobyteHD" returned: 0 in 0.921s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33e42bf2-291b-4f99-a2a0-b65489fbaec0_rw64wrqrdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:28 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2a959db-f614-4f72-8594-ef9cfe13e75e_aeb2q09n" returned: 0 in 0.858s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2a959db-f614-4f72-8594-ef9cfe13e75e_aeb2q09n {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:29 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9 1073741824" returned: 0 in 1.047s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:29 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9 Jul 03 01:26:29 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:29 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33e42bf2-291b-4f99-a2a0-b65489fbaec0_rw64wrqrdevstack@QuobyteHD Jul 03 01:26:29 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:29 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2a959db-f614-4f72-8594-ef9cfe13e75e_aeb2q09n Jul 03 01:26:29 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:29 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c6230d9-04f9-4239-9dc0-aaaed9d8db49 tempest-CreateVolumesFromImageTest-568957811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-dd9315ea-b8df-43bd-a698-0bb0a6060997" returned: 0 in 0.956s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c6230d9-04f9-4239-9dc0-aaaed9d8db49 tempest-CreateVolumesFromImageTest-568957811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-dd9315ea-b8df-43bd-a698-0bb0a6060997 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:29 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-dd9315ea-b8df-43bd-a698-0bb0a6060997 Jul 03 01:26:29 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:29 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33e42bf2-291b-4f99-a2a0-b65489fbaec0_rw64wrqrdevstack@QuobyteHD" returned: 1 in 0.841s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33e42bf2-291b-4f99-a2a0-b65489fbaec0_rw64wrqrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] 33e42bf2-291b-4f99-a2a0-b65489fbaec0 was raw, converting to raw {{(pid=86772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_33e42bf2-291b-4f99-a2a0-b65489fbaec0_rw64wrqrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:29 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9" returned: 0 in 0.727s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.143s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-536058843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bebff1ee-10b9-49b2-95e7-058f0e7dfd91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d539b1dece4644adb55fcef6ee3858a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:25Z,use_quota=True,user_id='57326ac8ac444f7b89113fe37c762a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Creating volume bebff1ee-10b9-49b2-95e7-058f0e7dfd91 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:29 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:26:29 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bebff1ee-10b9-49b2-95e7-058f0e7dfd91 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:29 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_33e42bf2-291b-4f99-a2a0-b65489fbaec0_rw64wrqrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2 Jul 03 01:26:29 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2a959db-f614-4f72-8594-ef9cfe13e75e_aeb2q09n" returned: 1 in 0.875s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2a959db-f614-4f72-8594-ef9cfe13e75e_aeb2q09n' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e69ebc-f3cf-46bf-80ef-413a0bd64987]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a959db-f614-4f72-8594-ef9cfe13e75e_nbto8uupdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:29 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bebff1ee-10b9-49b2-95e7-058f0e7dfd91 1073741824 Jul 03 01:26:29 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b168e48b-446e-4f7e-bafb-bfc0444b7dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eece8303-a0e3-40a2-a2ec-f7ba116a07a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:29 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Volume volume-7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9 (7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9): created successfully Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eece8303-a0e3-40a2-a2ec-f7ba116a07a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Flow 'volume_create_manager' (d9c08457-3eba-4eba-a542-934928712ea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:29 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6e3df617-3871-4aa2-85e8-059b86c59910 tempest-CreateVolumesFromSnapshotTest-332290763 None] Created volume successfully. Jul 03 01:26:30 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a959db-f614-4f72-8594-ef9cfe13e75e_nbto8uupdevstack@QuobyteHD Jul 03 01:26:30 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:30 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c6230d9-04f9-4239-9dc0-aaaed9d8db49 tempest-CreateVolumesFromImageTest-568957811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-dd9315ea-b8df-43bd-a698-0bb0a6060997" returned: 0 in 0.771s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c6230d9-04f9-4239-9dc0-aaaed9d8db49 tempest-CreateVolumesFromImageTest-568957811 None] Lock "cinder-quobyte-dd9315ea-b8df-43bd-a698-0bb0a6060997" released by "delete_volume" :: held 1.821s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:30 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-1c6230d9-04f9-4239-9dc0-aaaed9d8db49 tempest-CreateVolumesFromImageTest-568957811 None] Created reservations ['834833ef-939c-4df8-be21-271ff425cf82', 'b226b454-8530-4467-8f52-42778669e851', 'eba9a92a-1417-4107-ab37-f3d594936a30', '5c17cd5a-000c-44d7-8b4c-06e2fc751b50'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:26:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1c6230d9-04f9-4239-9dc0-aaaed9d8db49 tempest-CreateVolumesFromImageTest-568957811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1c6230d9-04f9-4239-9dc0-aaaed9d8db49 tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1c6230d9-04f9-4239-9dc0-aaaed9d8db49 tempest-CreateVolumesFromImageTest-568957811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1c6230d9-04f9-4239-9dc0-aaaed9d8db49 tempest-CreateVolumesFromImageTest-568957811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1c6230d9-04f9-4239-9dc0-aaaed9d8db49 tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c6230d9-04f9-4239-9dc0-aaaed9d8db49 tempest-CreateVolumesFromImageTest-568957811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:30 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:26:30 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-37ae0357-21dc-4e14-b0bf-8fc6f4b055b5 tempest-CreateVolumesFromImageTest-568957811 None] Acquiring lock "cinder-160d93de-4940-4b21-9227-7a08f5637cf0-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-37ae0357-21dc-4e14-b0bf-8fc6f4b055b5 tempest-CreateVolumesFromImageTest-568957811 None] Lock "cinder-160d93de-4940-4b21-9227-7a08f5637cf0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-37ae0357-21dc-4e14-b0bf-8fc6f4b055b5 tempest-CreateVolumesFromImageTest-568957811 None] Acquiring lock "cinder-quobyte-160d93de-4940-4b21-9227-7a08f5637cf0" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-37ae0357-21dc-4e14-b0bf-8fc6f4b055b5 tempest-CreateVolumesFromImageTest-568957811 None] Lock "cinder-quobyte-160d93de-4940-4b21-9227-7a08f5637cf0" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:30 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dab97b6-67fc-48e2-80f4-4fc01f76515f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-37ae0357-21dc-4e14-b0bf-8fc6f4b055b5 tempest-CreateVolumesFromImageTest-568957811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-160d93de-4940-4b21-9227-7a08f5637cf0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:30 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_33e42bf2-291b-4f99-a2a0-b65489fbaec0_rw64wrqrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2" returned: 0 in 1.004s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:30 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_33e42bf2-291b-4f99-a2a0-b65489fbaec0_rw64wrqrdevstack@QuobyteHD, size 0.00 MB, duration 1.01 sec, destination /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2 {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:26:30 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 01:26:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:30 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-160d93de-4940-4b21-9227-7a08f5637cf0 Jul 03 01:26:30 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:30 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2 1G Jul 03 01:26:30 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:31 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a959db-f614-4f72-8594-ef9cfe13e75e_nbto8uupdevstack@QuobyteHD" returned: 0 in 1.128s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a959db-f614-4f72-8594-ef9cfe13e75e_nbto8uupdevstack@QuobyteHD {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:31 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bebff1ee-10b9-49b2-95e7-058f0e7dfd91 1073741824" returned: 0 in 1.190s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bebff1ee-10b9-49b2-95e7-058f0e7dfd91 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:31 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bebff1ee-10b9-49b2-95e7-058f0e7dfd91 Jul 03 01:26:31 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:31 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1c6230d9-04f9-4239-9dc0-aaaed9d8db49 tempest-CreateVolumesFromImageTest-568957811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.913s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-1c6230d9-04f9-4239-9dc0-aaaed9d8db49 tempest-CreateVolumesFromImageTest-568957811 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:26:31 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a959db-f614-4f72-8594-ef9cfe13e75e_nbto8uupdevstack@QuobyteHD Jul 03 01:26:31 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:31 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1c6230d9-04f9-4239-9dc0-aaaed9d8db49 tempest-CreateVolumesFromImageTest-568957811 None] Deleted volume successfully. Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1c6230d9-04f9-4239-9dc0-aaaed9d8db49 tempest-CreateVolumesFromImageTest-568957811 None] Lock "cinder-dd9315ea-b8df-43bd-a698-0bb0a6060997-delete_volume" released by "delete_volume" :: held 3.087s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:31 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-37ae0357-21dc-4e14-b0bf-8fc6f4b055b5 tempest-CreateVolumesFromImageTest-568957811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-160d93de-4940-4b21-9227-7a08f5637cf0" returned: 0 in 0.873s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-37ae0357-21dc-4e14-b0bf-8fc6f4b055b5 tempest-CreateVolumesFromImageTest-568957811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-160d93de-4940-4b21-9227-7a08f5637cf0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:31 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-160d93de-4940-4b21-9227-7a08f5637cf0 Jul 03 01:26:31 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:31 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2 1G" returned: 0 in 0.922s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9d221f-cca8-44b6-b781-96dbf83ebddf]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:31 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2 Jul 03 01:26:31 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:31 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bebff1ee-10b9-49b2-95e7-058f0e7dfd91" returned: 0 in 0.844s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] <== create_volume: return (2103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.106s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.767s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-721684525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=046042d3-64e2-481f-9ff9-d7cefd3e4dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d539b1dece4644adb55fcef6ee3858a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:26Z,use_quota=True,user_id='57326ac8ac444f7b89113fe37c762a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Creating volume 046042d3-64e2-481f-9ff9-d7cefd3e4dbe {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:26:31 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-046042d3-64e2-481f-9ff9-d7cefd3e4dbe 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:31 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a959db-f614-4f72-8594-ef9cfe13e75e_nbto8uupdevstack@QuobyteHD" returned: 1 in 0.979s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2a959db-f614-4f72-8594-ef9cfe13e75e_nbto8uupdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] e2a959db-f614-4f72-8594-ef9cfe13e75e was raw, converting to raw {{(pid=86772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 03 01:26:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e2a959db-f614-4f72-8594-ef9cfe13e75e_nbto8uupdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:31 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-046042d3-64e2-481f-9ff9-d7cefd3e4dbe 1073741824 Jul 03 01:26:32 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e456960-5652-481e-a0d5-de2da353a2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bebff1ee-10b9-49b2-95e7-058f0e7dfd91', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:32 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e2a959db-f614-4f72-8594-ef9cfe13e75e_nbto8uupdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae Jul 03 01:26:32 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd5f1225-a1e7-4827-b749-6c3315119e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:32 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Volume volume-bebff1ee-10b9-49b2-95e7-058f0e7dfd91 (bebff1ee-10b9-49b2-95e7-058f0e7dfd91): created successfully Jul 03 01:26:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd5f1225-a1e7-4827-b749-6c3315119e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Flow 'volume_create_manager' (eaf0054d-6629-4759-9c6d-410e54d921a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:32 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1f05f43c-7171-4425-b41f-a0385c4916e0 tempest-CreateVolumesFromSnapshotTest-332290763 None] Created volume successfully. Jul 03 01:26:32 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-37ae0357-21dc-4e14-b0bf-8fc6f4b055b5 tempest-CreateVolumesFromImageTest-568957811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-160d93de-4940-4b21-9227-7a08f5637cf0" returned: 0 in 0.819s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-37ae0357-21dc-4e14-b0bf-8fc6f4b055b5 tempest-CreateVolumesFromImageTest-568957811 None] Lock "cinder-quobyte-160d93de-4940-4b21-9227-7a08f5637cf0" released by "delete_volume" :: held 1.750s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:32 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-37ae0357-21dc-4e14-b0bf-8fc6f4b055b5 tempest-CreateVolumesFromImageTest-568957811 None] Created reservations ['d49bad3d-85f1-4fcf-a199-02723f171e0c', 'a3442bc3-9ecd-40ed-a25c-dbfd6b59b2e0', '9f5ea748-a172-435d-a7e2-121c47df521e', 'd0d7cf92-2ca6-4c70-93b6-8880198a870f'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:26:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-37ae0357-21dc-4e14-b0bf-8fc6f4b055b5 tempest-CreateVolumesFromImageTest-568957811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-37ae0357-21dc-4e14-b0bf-8fc6f4b055b5 tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-37ae0357-21dc-4e14-b0bf-8fc6f4b055b5 tempest-CreateVolumesFromImageTest-568957811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-37ae0357-21dc-4e14-b0bf-8fc6f4b055b5 tempest-CreateVolumesFromImageTest-568957811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-37ae0357-21dc-4e14-b0bf-8fc6f4b055b5 tempest-CreateVolumesFromImageTest-568957811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-37ae0357-21dc-4e14-b0bf-8fc6f4b055b5 tempest-CreateVolumesFromImageTest-568957811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:32 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:26:32 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:32 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2" returned: 0 in 1.039s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:32 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e2a959db-f614-4f72-8594-ef9cfe13e75e_nbto8uupdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae" returned: 0 in 0.909s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:32 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e2a959db-f614-4f72-8594-ef9cfe13e75e_nbto8uupdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:26:32 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Converted 0.00 MB image at 0.00 MB/s Jul 03 01:26:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:32 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae 1G Jul 03 01:26:32 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:32 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-046042d3-64e2-481f-9ff9-d7cefd3e4dbe 1073741824" returned: 0 in 0.989s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-046042d3-64e2-481f-9ff9-d7cefd3e4dbe {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:33 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2 Jul 03 01:26:33 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:33 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-046042d3-64e2-481f-9ff9-d7cefd3e4dbe Jul 03 01:26:33 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:33 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-37ae0357-21dc-4e14-b0bf-8fc6f4b055b5 tempest-CreateVolumesFromImageTest-568957811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.831s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-37ae0357-21dc-4e14-b0bf-8fc6f4b055b5 tempest-CreateVolumesFromImageTest-568957811 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:26:33 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-37ae0357-21dc-4e14-b0bf-8fc6f4b055b5 tempest-CreateVolumesFromImageTest-568957811 None] Deleted volume successfully. Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-37ae0357-21dc-4e14-b0bf-8fc6f4b055b5 tempest-CreateVolumesFromImageTest-568957811 None] Lock "cinder-160d93de-4940-4b21-9227-7a08f5637cf0-delete_volume" released by "delete_volume" :: held 2.923s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:33 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-046042d3-64e2-481f-9ff9-d7cefd3e4dbe" returned: 0 in 0.862s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.919s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:33 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:33 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.152s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-473433686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5468ce3e-d29f-4f10-844e-770a12e71468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d539b1dece4644adb55fcef6ee3858a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:26Z,use_quota=True,user_id='57326ac8ac444f7b89113fe37c762a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Creating volume 5468ce3e-d29f-4f10-844e-770a12e71468 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:26:33 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5468ce3e-d29f-4f10-844e-770a12e71468 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2" returned: 1 in 1.074s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae 1G" returned: 0 in 1.011s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Downloaded image 33e42bf2-291b-4f99-a2a0-b65489fbaec0 ((None, [{'url': 'file:///opt/stack/data/glance/images/33e42bf2-291b-4f99-a2a0-b65489fbaec0', 'metadata': {}}])) to volume 5638836b-bf35-43bd-912c-970d96b203a2 successfully. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Temporary image 33e42bf2-291b-4f99-a2a0-b65489fbaec0 for user 879f004050fd45f1bcc234ec44141122 is deleted. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Marking volume 5638836b-bf35-43bd-912c-970d96b203a2 as bootable. {{(pid=86772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 01:26:33 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5468ce3e-d29f-4f10-844e-770a12e71468 1073741824 Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc60ecd-7634-47d0-a213-b66b86174c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-046042d3-64e2-481f-9ff9-d7cefd3e4dbe', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74e2317-71aa-4b3c-8fc6-1a32f2290bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:33 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Copying metadata from image 33e42bf2-291b-4f99-a2a0-b65489fbaec0 to 5638836b-bf35-43bd-912c-970d96b203a2. {{(pid=86772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Creating volume glance metadata for volume 5638836b-bf35-43bd-912c-970d96b203a2 backed by image 33e42bf2-291b-4f99-a2a0-b65489fbaec0 with: {'image_id': '33e42bf2-291b-4f99-a2a0-b65489fbaec0', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c75e60600e9f879abdd7a7a30988ef92', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 01:26:33 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Volume volume-046042d3-64e2-481f-9ff9-d7cefd3e4dbe (046042d3-64e2-481f-9ff9-d7cefd3e4dbe): created successfully Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74e2317-71aa-4b3c-8fc6-1a32f2290bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Flow 'volume_create_manager' (cbf467ae-6f12-4d0d-ad2e-51d4a4c55c41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[db02ae02-5341-4e00-9532-33667e6830d8]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:34 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1267719d-46cd-47f5-a00c-8397e62418ed tempest-CreateVolumesFromSnapshotTest-332290763 None] Created volume successfully. Jul 03 01:26:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060978a7-e895-4685-a138-9ece4219c76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5638836b-bf35-43bd-912c-970d96b203a2', 'volume_size': 1, 'image_id': '33e42bf2-291b-4f99-a2a0-b65489fbaec0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33e42bf2-291b-4f99-a2a0-b65489fbaec0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c75e60600e9f879abdd7a7a30988ef92', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '53da4aa6de474d7b9040c39cdd7be826', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b1e6fe63d81831b21f79a1059d19b5f305a2c0f22a5d1fb3d61267e1528fb3cb1341206d064a8ea3aeabbf8579dc277d0a542502ad5b8fc5d009295a4074badb', 'id': '33e42bf2-291b-4f99-a2a0-b65489fbaec0', 'created_at': datetime.datetime(2026, 7, 2, 23, 26, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 26, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33e42bf2-291b-4f99-a2a0-b65489fbaec0/file', 'properties': {}}, 'image_service': }' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb85f37-e404-4f7a-b9cd-496bd834b9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:34 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Volume volume-5638836b-bf35-43bd-912c-970d96b203a2 (5638836b-bf35-43bd-912c-970d96b203a2): created successfully Jul 03 01:26:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb85f37-e404-4f7a-b9cd-496bd834b9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Flow 'volume_create_manager' (b2d18653-984e-4c84-b849-afba8a18ede6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:34 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-21a21c4d-d71b-4b2a-a4b3-9d167334f099 tempest-VolumeImageDependencyTests-305419966 None] Created volume successfully. Jul 03 01:26:34 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae Jul 03 01:26:34 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e279943d-2924-4e74-a927-f93f8a24c189 tempest-VolumeImageDependencyTests-305419966 None] Acquiring lock "cinder-5638836b-bf35-43bd-912c-970d96b203a2-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e279943d-2924-4e74-a927-f93f8a24c189 tempest-VolumeImageDependencyTests-305419966 None] Lock "cinder-5638836b-bf35-43bd-912c-970d96b203a2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e279943d-2924-4e74-a927-f93f8a24c189 tempest-VolumeImageDependencyTests-305419966 None] Acquiring lock "cinder-quobyte-5638836b-bf35-43bd-912c-970d96b203a2" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e279943d-2924-4e74-a927-f93f8a24c189 tempest-VolumeImageDependencyTests-305419966 None] Lock "cinder-quobyte-5638836b-bf35-43bd-912c-970d96b203a2" acquired by "delete_volume" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:34 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae" returned: 0 in 0.997s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c5a6d2-980e-4146-90f0-ddcde08c4345]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e279943d-2924-4e74-a927-f93f8a24c189 tempest-VolumeImageDependencyTests-305419966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:35 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5468ce3e-d29f-4f10-844e-770a12e71468 1073741824" returned: 0 in 1.164s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5468ce3e-d29f-4f10-844e-770a12e71468 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:35 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae Jul 03 01:26:35 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:35 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5468ce3e-d29f-4f10-844e-770a12e71468 Jul 03 01:26:35 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:35 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2 Jul 03 01:26:35 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:35 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae" returned: 1 in 0.843s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Downloaded image e2a959db-f614-4f72-8594-ef9cfe13e75e ((None, [{'url': 'file:///opt/stack/data/glance/images/e2a959db-f614-4f72-8594-ef9cfe13e75e', 'metadata': {}}])) to volume 20642463-297c-4f68-a491-ef02b77f60ae successfully. {{(pid=86772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Temporary image e2a959db-f614-4f72-8594-ef9cfe13e75e for user ff31815b26a449cc92ac1cc8b7922872 is deleted. {{(pid=86772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG cinder.volume.volume_utils [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Marking volume 20642463-297c-4f68-a491-ef02b77f60ae as bootable. {{(pid=86772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Copying metadata from image e2a959db-f614-4f72-8594-ef9cfe13e75e to 20642463-297c-4f68-a491-ef02b77f60ae. {{(pid=86772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Creating volume glance metadata for volume 20642463-297c-4f68-a491-ef02b77f60ae backed by image e2a959db-f614-4f72-8594-ef9cfe13e75e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e2a959db-f614-4f72-8594-ef9cfe13e75e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '94fbbd1f06b5eb8ff172117903187ba1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 03 01:26:35 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5468ce3e-d29f-4f10-844e-770a12e71468" returned: 0 in 0.831s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.779s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-591915405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5353826b-a438-45bf-a3a8-85870b3cdef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d539b1dece4644adb55fcef6ee3858a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:27Z,use_quota=True,user_id='57326ac8ac444f7b89113fe37c762a67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Creating volume 5353826b-a438-45bf-a3a8-85870b3cdef2 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:35 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:26:35 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5353826b-a438-45bf-a3a8-85870b3cdef2 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0357d0af-d05f-41be-a53a-d84029a4dc53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20642463-297c-4f68-a491-ef02b77f60ae', 'volume_size': 1, 'image_id': 'e2a959db-f614-4f72-8594-ef9cfe13e75e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2a959db-f614-4f72-8594-ef9cfe13e75e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '94fbbd1f06b5eb8ff172117903187ba1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9a754306a15b424e8615890a4993b107', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'adf33f23035fecdd73597747b22b61be77a176fe7ff5b9227b1400be61c7a8e7180f89fa33f6160a10f50179564866cd0121af5820cbdb5b96c3ba06ef3f7606', 'id': 'e2a959db-f614-4f72-8594-ef9cfe13e75e', 'created_at': datetime.datetime(2026, 7, 2, 23, 26, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 2, 23, 26, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2a959db-f614-4f72-8594-ef9cfe13e75e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c3e0470-0d5a-4bb3-86a0-dea2008a2bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:35 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5353826b-a438-45bf-a3a8-85870b3cdef2 1073741824 Jul 03 01:26:35 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e279943d-2924-4e74-a927-f93f8a24c189 tempest-VolumeImageDependencyTests-305419966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2" returned: 0 in 0.960s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4315e9bd-e542-4867-b471-287a685a463a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5468ce3e-d29f-4f10-844e-770a12e71468', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f00d6d6-8f47-4aee-a143-1e0078ed66e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e279943d-2924-4e74-a927-f93f8a24c189 tempest-VolumeImageDependencyTests-305419966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:36 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Volume volume-5468ce3e-d29f-4f10-844e-770a12e71468 (5468ce3e-d29f-4f10-844e-770a12e71468): created successfully Jul 03 01:26:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f00d6d6-8f47-4aee-a143-1e0078ed66e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Flow 'volume_create_manager' (4b794ff6-1a0a-4199-bf9f-05d002583ce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:36 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Volume volume-20642463-297c-4f68-a491-ef02b77f60ae (20642463-297c-4f68-a491-ef02b77f60ae): created successfully Jul 03 01:26:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c3e0470-0d5a-4bb3-86a0-dea2008a2bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Flow 'volume_create_manager' (ecfe7add-581d-48c9-8b9d-b4b1c50f3fb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:36 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-03942445-fdc8-420f-a9ac-5ebce3ae8642 tempest-CreateVolumesFromSnapshotTest-332290763 None] Created volume successfully. Jul 03 01:26:36 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-783a94e1-cc4f-40b6-93ca-d1887fe29e28 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Created volume successfully. Jul 03 01:26:36 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2 Jul 03 01:26:36 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:36 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:26:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Flow 'volume_create_manager' (81bda31b-0dfa-4529-afb4-ce153cf5b4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (697a5c14-2c84-4ab8-990b-d7234d6b3b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (697a5c14-2c84-4ab8-990b-d7234d6b3b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-944932454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759d8a76-6a04-43dd-8cf1-5363bcadc07a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e1ebe9ddf148218d1860659c291c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:36Z,use_quota=True,user_id='5291f1374f4a4b9cb68e51ed3f6cbc95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2717eef-83eb-4901-aa96-988f540e385b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2717eef-83eb-4901-aa96-988f540e385b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9168f0-c9f0-4941-93e4-1fff3718104f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9168f0-c9f0-4941-93e4-1fff3718104f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '759d8a76-6a04-43dd-8cf1-5363bcadc07a', 'volume_name': 'volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b040974-e8d3-4132-ae00-15a14643597e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b040974-e8d3-4132-ae00-15a14643597e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c066a0-cce9-436c-b9f2-64ca9fa061c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:36 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Volume 759d8a76-6a04-43dd-8cf1-5363bcadc07a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a', 'volume_size': 1} Jul 03 01:26:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:36 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5353826b-a438-45bf-a3a8-85870b3cdef2 1073741824" returned: 0 in 0.867s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5353826b-a438-45bf-a3a8-85870b3cdef2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:36 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e279943d-2924-4e74-a927-f93f8a24c189 tempest-VolumeImageDependencyTests-305419966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2" returned: 1 in 0.871s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e279943d-2924-4e74-a927-f93f8a24c189 tempest-VolumeImageDependencyTests-305419966 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:26:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e279943d-2924-4e74-a927-f93f8a24c189 tempest-VolumeImageDependencyTests-305419966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:36 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5353826b-a438-45bf-a3a8-85870b3cdef2 Jul 03 01:26:36 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-705486e5-55ba-4d47-900f-6480a319b782 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Acquiring lock "cinder-20642463-297c-4f68-a491-ef02b77f60ae-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:36 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2 Jul 03 01:26:36 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-705486e5-55ba-4d47-900f-6480a319b782 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Lock "cinder-20642463-297c-4f68-a491-ef02b77f60ae-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-705486e5-55ba-4d47-900f-6480a319b782 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Acquiring lock "cinder-quobyte-20642463-297c-4f68-a491-ef02b77f60ae" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-705486e5-55ba-4d47-900f-6480a319b782 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Lock "cinder-quobyte-20642463-297c-4f68-a491-ef02b77f60ae" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e284aa5-daaa-4a57-8b0d-b5e762c49831]: (4, 'raw') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-705486e5-55ba-4d47-900f-6480a319b782 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:37 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae Jul 03 01:26:37 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:37 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5353826b-a438-45bf-a3a8-85870b3cdef2" returned: 0 in 0.720s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:37 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.019s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-944932454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759d8a76-6a04-43dd-8cf1-5363bcadc07a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e1ebe9ddf148218d1860659c291c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:36Z,use_quota=True,user_id='5291f1374f4a4b9cb68e51ed3f6cbc95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Creating volume 759d8a76-6a04-43dd-8cf1-5363bcadc07a {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:26:37 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e279943d-2924-4e74-a927-f93f8a24c189 tempest-VolumeImageDependencyTests-305419966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5638836b-bf35-43bd-912c-970d96b203a2" returned: 0 in 0.741s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:37 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a 1073741824 Jul 03 01:26:37 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f1514c-7943-4c6f-9b44-266c1bb8abac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5353826b-a438-45bf-a3a8-85870b3cdef2', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9470dea-69eb-4aac-88d2-0881419bb201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e279943d-2924-4e74-a927-f93f8a24c189 tempest-VolumeImageDependencyTests-305419966 None] Lock "cinder-quobyte-5638836b-bf35-43bd-912c-970d96b203a2" released by "delete_volume" :: held 2.684s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:37 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Volume volume-5353826b-a438-45bf-a3a8-85870b3cdef2 (5353826b-a438-45bf-a3a8-85870b3cdef2): created successfully Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9470dea-69eb-4aac-88d2-0881419bb201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Flow 'volume_create_manager' (ddec8308-4b64-49b1-8bec-a8183049ac4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:37 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-565ddfb2-80ba-40a6-a384-b3d2e724cba8 tempest-CreateVolumesFromSnapshotTest-332290763 None] Created volume successfully. Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e279943d-2924-4e74-a927-f93f8a24c189 tempest-VolumeImageDependencyTests-305419966 None] Created reservations ['586fe233-db03-44b2-8db9-38585843d6f5', '7764064a-f87f-45a2-b993-f5c2ba614465', '505fd384-8681-4c66-8a94-baabb47959c0', 'c5b8c093-81f1-4eda-858e-069d76adca40'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e279943d-2924-4e74-a927-f93f8a24c189 tempest-VolumeImageDependencyTests-305419966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e279943d-2924-4e74-a927-f93f8a24c189 tempest-VolumeImageDependencyTests-305419966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e279943d-2924-4e74-a927-f93f8a24c189 tempest-VolumeImageDependencyTests-305419966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e279943d-2924-4e74-a927-f93f8a24c189 tempest-VolumeImageDependencyTests-305419966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e279943d-2924-4e74-a927-f93f8a24c189 tempest-VolumeImageDependencyTests-305419966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e279943d-2924-4e74-a927-f93f8a24c189 tempest-VolumeImageDependencyTests-305419966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:37 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:26:37 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:37 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-705486e5-55ba-4d47-900f-6480a319b782 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae" returned: 0 in 0.849s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-705486e5-55ba-4d47-900f-6480a319b782 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:38 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae Jul 03 01:26:38 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-368185a0-35a5-438a-ab6e-c1feaf1d3299 tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "cinder-5353826b-a438-45bf-a3a8-85870b3cdef2-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:38 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e279943d-2924-4e74-a927-f93f8a24c189 tempest-VolumeImageDependencyTests-305419966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.825s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:38 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-e279943d-2924-4e74-a927-f93f8a24c189 tempest-VolumeImageDependencyTests-305419966 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:26:38 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e279943d-2924-4e74-a927-f93f8a24c189 tempest-VolumeImageDependencyTests-305419966 None] Deleted volume successfully. Jul 03 01:26:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-368185a0-35a5-438a-ab6e-c1feaf1d3299 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-5353826b-a438-45bf-a3a8-85870b3cdef2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e279943d-2924-4e74-a927-f93f8a24c189 tempest-VolumeImageDependencyTests-305419966 None] Lock "cinder-5638836b-bf35-43bd-912c-970d96b203a2-delete_volume" released by "delete_volume" :: held 3.809s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-368185a0-35a5-438a-ab6e-c1feaf1d3299 tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "cinder-quobyte-5353826b-a438-45bf-a3a8-85870b3cdef2" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-368185a0-35a5-438a-ab6e-c1feaf1d3299 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-quobyte-5353826b-a438-45bf-a3a8-85870b3cdef2" acquired by "delete_volume" :: waited 0.036s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:38 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a 1073741824" returned: 0 in 1.172s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:38 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5140ec-7c33-40bc-9ceb-9aa4785f5055]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-368185a0-35a5-438a-ab6e-c1feaf1d3299 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5353826b-a438-45bf-a3a8-85870b3cdef2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:38 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a Jul 03 01:26:38 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:38 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-705486e5-55ba-4d47-900f-6480a319b782 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae" returned: 1 in 0.960s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-705486e5-55ba-4d47-900f-6480a319b782 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae' failed. Not Retrying. {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 03 01:26:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-705486e5-55ba-4d47-900f-6480a319b782 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:38 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5353826b-a438-45bf-a3a8-85870b3cdef2 Jul 03 01:26:38 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:38 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae Jul 03 01:26:38 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:39 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a" returned: 0 in 0.847s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] <== create_volume: return (2082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:26:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.085s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:39 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-705486e5-55ba-4d47-900f-6480a319b782 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-20642463-297c-4f68-a491-ef02b77f60ae" returned: 0 in 0.782s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c066a0-cce9-436c-b9f2-64ca9fa061c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (166fc4d0-ca71-46b4-bbce-a4e351e8ac19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-705486e5-55ba-4d47-900f-6480a319b782 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Lock "cinder-quobyte-20642463-297c-4f68-a491-ef02b77f60ae" released by "delete_volume" :: held 2.698s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:39 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Volume volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a (759d8a76-6a04-43dd-8cf1-5363bcadc07a): created successfully Jul 03 01:26:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (166fc4d0-ca71-46b4-bbce-a4e351e8ac19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:39 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Flow 'volume_create_manager' (81bda31b-0dfa-4529-afb4-ce153cf5b4f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:39 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-368185a0-35a5-438a-ab6e-c1feaf1d3299 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5353826b-a438-45bf-a3a8-85870b3cdef2" returned: 0 in 0.997s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-368185a0-35a5-438a-ab6e-c1feaf1d3299 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5353826b-a438-45bf-a3a8-85870b3cdef2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:39 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c8b25988-6c06-4471-95c4-236c324bcfd5 tempest-VolumeDependencyTests-554197803 None] Created volume successfully. Jul 03 01:26:39 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5353826b-a438-45bf-a3a8-85870b3cdef2 Jul 03 01:26:39 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:39 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-705486e5-55ba-4d47-900f-6480a319b782 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Created reservations ['78e99443-3a09-4ffb-aef3-0ec99b7185d8', '3d40558a-8fe9-4846-8fd0-9a85bc3bbeb0', '68a2d7bd-d37e-420c-a3ae-fd36a2b89f34', 'a811190e-5781-44e2-b7c0-f9d0f1fed67a'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:26:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-705486e5-55ba-4d47-900f-6480a319b782 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-705486e5-55ba-4d47-900f-6480a319b782 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-705486e5-55ba-4d47-900f-6480a319b782 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-705486e5-55ba-4d47-900f-6480a319b782 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-705486e5-55ba-4d47-900f-6480a319b782 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-705486e5-55ba-4d47-900f-6480a319b782 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:39 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:26:39 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:40 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-705486e5-55ba-4d47-900f-6480a319b782 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.761s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:40 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-705486e5-55ba-4d47-900f-6480a319b782 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:26:40 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-368185a0-35a5-438a-ab6e-c1feaf1d3299 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5353826b-a438-45bf-a3a8-85870b3cdef2" returned: 0 in 0.922s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:40 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-705486e5-55ba-4d47-900f-6480a319b782 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Deleted volume successfully. Jul 03 01:26:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-368185a0-35a5-438a-ab6e-c1feaf1d3299 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-quobyte-5353826b-a438-45bf-a3a8-85870b3cdef2" released by "delete_volume" :: held 1.988s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-705486e5-55ba-4d47-900f-6480a319b782 tempest-VolumeAndVolumeTypeFromImageTest-1331920611 None] Lock "cinder-20642463-297c-4f68-a491-ef02b77f60ae-delete_volume" released by "delete_volume" :: held 3.825s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:40 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-368185a0-35a5-438a-ab6e-c1feaf1d3299 tempest-CreateVolumesFromSnapshotTest-332290763 None] Created reservations ['594742a6-7515-491f-9b4c-f4e20d3b5296', '147ead94-15da-4a7d-a408-381f5575e31b', 'fc436edd-9ed6-491b-9219-559734d3ba42', 'c6c1cae6-492b-418d-880a-7b322bb66865'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:26:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-368185a0-35a5-438a-ab6e-c1feaf1d3299 tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-368185a0-35a5-438a-ab6e-c1feaf1d3299 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-368185a0-35a5-438a-ab6e-c1feaf1d3299 tempest-CreateVolumesFromSnapshotTest-332290763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-368185a0-35a5-438a-ab6e-c1feaf1d3299 tempest-CreateVolumesFromSnapshotTest-332290763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-368185a0-35a5-438a-ab6e-c1feaf1d3299 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-368185a0-35a5-438a-ab6e-c1feaf1d3299 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:40 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:26:40 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-735e70ed-a181-42dd-b60f-b7e00c7bc04b tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "cinder-5468ce3e-d29f-4f10-844e-770a12e71468-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-735e70ed-a181-42dd-b60f-b7e00c7bc04b tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-5468ce3e-d29f-4f10-844e-770a12e71468-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-735e70ed-a181-42dd-b60f-b7e00c7bc04b tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "cinder-quobyte-5468ce3e-d29f-4f10-844e-770a12e71468" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-735e70ed-a181-42dd-b60f-b7e00c7bc04b tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-quobyte-5468ce3e-d29f-4f10-844e-770a12e71468" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:41 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dcbdae-019a-41d4-8e59-ed3cf8e656f8]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-735e70ed-a181-42dd-b60f-b7e00c7bc04b tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5468ce3e-d29f-4f10-844e-770a12e71468 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-01ab26d2-a5f6-4b04-b15c-0693fccd8165 tempest-VolumeDependencyTests-554197803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-01ab26d2-a5f6-4b04-b15c-0693fccd8165 tempest-VolumeDependencyTests-554197803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-01ab26d2-a5f6-4b04-b15c-0693fccd8165 tempest-VolumeDependencyTests-554197803 None] Creating offline snapshot 4648fa6e-254e-4f2e-848e-a0e845a534d1 of volume 759d8a76-6a04-43dd-8cf1-5363bcadc07a {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:26:41 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e90900-a3ce-4766-bee5-e711561fbee2]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-01ab26d2-a5f6-4b04-b15c-0693fccd8165 tempest-VolumeDependencyTests-554197803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:41 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5468ce3e-d29f-4f10-844e-770a12e71468 Jul 03 01:26:41 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:41 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a Jul 03 01:26:41 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:41 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-368185a0-35a5-438a-ab6e-c1feaf1d3299 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.792s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:41 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-368185a0-35a5-438a-ab6e-c1feaf1d3299 tempest-CreateVolumesFromSnapshotTest-332290763 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:26:41 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-368185a0-35a5-438a-ab6e-c1feaf1d3299 tempest-CreateVolumesFromSnapshotTest-332290763 None] Deleted volume successfully. Jul 03 01:26:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-368185a0-35a5-438a-ab6e-c1feaf1d3299 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-5353826b-a438-45bf-a3a8-85870b3cdef2-delete_volume" released by "delete_volume" :: held 3.074s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:42 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-735e70ed-a181-42dd-b60f-b7e00c7bc04b tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5468ce3e-d29f-4f10-844e-770a12e71468" returned: 0 in 1.006s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-735e70ed-a181-42dd-b60f-b7e00c7bc04b tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5468ce3e-d29f-4f10-844e-770a12e71468 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:42 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5468ce3e-d29f-4f10-844e-770a12e71468 Jul 03 01:26:42 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:42 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-01ab26d2-a5f6-4b04-b15c-0693fccd8165 tempest-VolumeDependencyTests-554197803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a" returned: 0 in 1.218s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-01ab26d2-a5f6-4b04-b15c-0693fccd8165 tempest-VolumeDependencyTests-554197803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.4648fa6e-254e-4f2e-848e-a0e845a534d1 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:42 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.4648fa6e-254e-4f2e-848e-a0e845a534d1 1G Jul 03 01:26:42 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:42 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:26:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Flow 'volume_create_manager' (9a8b0d6b-be8c-4be4-94de-bf1318adfbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ca807a-696e-447b-aff2-2ba7bf783b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ca807a-696e-447b-aff2-2ba7bf783b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d91bdfccee744a3909ebfd83139356b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:43Z,use_quota=True,user_id='84d684e3fd174d5fa404e41b07f67cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e554a3b-f0b6-46fc-b093-27fa63412699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e554a3b-f0b6-46fc-b093-27fa63412699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b5f6fd-6bab-4f2e-afcd-db5db22369a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b5f6fd-6bab-4f2e-afcd-db5db22369a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5', 'volume_name': 'volume-5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8a45e5-a86f-489e-8afa-cf434ae6f6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8a45e5-a86f-489e-8afa-cf434ae6f6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd9e8ca8-4c79-4246-a1ca-370be5b03c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:42 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Volume 5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5', 'volume_size': 1} Jul 03 01:26:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:43 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-735e70ed-a181-42dd-b60f-b7e00c7bc04b tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5468ce3e-d29f-4f10-844e-770a12e71468" returned: 0 in 0.909s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-735e70ed-a181-42dd-b60f-b7e00c7bc04b tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-quobyte-5468ce3e-d29f-4f10-844e-770a12e71468" released by "delete_volume" :: held 1.976s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:43 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-735e70ed-a181-42dd-b60f-b7e00c7bc04b tempest-CreateVolumesFromSnapshotTest-332290763 None] Created reservations ['f22fe0e8-bad8-45c3-8892-237eb468cc16', '4c156faf-7295-4d7b-a5d5-7f6cc4b6a5c4', '6bcb4f82-8b46-4d25-afad-581631adc337', 'a468fa6b-96b4-435e-bb6f-64f0ec82c140'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:26:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-735e70ed-a181-42dd-b60f-b7e00c7bc04b tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-735e70ed-a181-42dd-b60f-b7e00c7bc04b tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-735e70ed-a181-42dd-b60f-b7e00c7bc04b tempest-CreateVolumesFromSnapshotTest-332290763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-735e70ed-a181-42dd-b60f-b7e00c7bc04b tempest-CreateVolumesFromSnapshotTest-332290763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-735e70ed-a181-42dd-b60f-b7e00c7bc04b tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-735e70ed-a181-42dd-b60f-b7e00c7bc04b tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:43 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:26:43 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-97742a0e-991d-432a-8915-c21d9fe73da2 tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "cinder-046042d3-64e2-481f-9ff9-d7cefd3e4dbe-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-97742a0e-991d-432a-8915-c21d9fe73da2 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-046042d3-64e2-481f-9ff9-d7cefd3e4dbe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-97742a0e-991d-432a-8915-c21d9fe73da2 tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "cinder-quobyte-046042d3-64e2-481f-9ff9-d7cefd3e4dbe" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-97742a0e-991d-432a-8915-c21d9fe73da2 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-quobyte-046042d3-64e2-481f-9ff9-d7cefd3e4dbe" acquired by "delete_volume" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:43 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56bc376-b0bb-46ea-a994-00400ad6191d]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-97742a0e-991d-432a-8915-c21d9fe73da2 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-046042d3-64e2-481f-9ff9-d7cefd3e4dbe {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:43 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-01ab26d2-a5f6-4b04-b15c-0693fccd8165 tempest-VolumeDependencyTests-554197803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.4648fa6e-254e-4f2e-848e-a0e845a534d1 1G" returned: 0 in 1.071s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-01ab26d2-a5f6-4b04-b15c-0693fccd8165 tempest-VolumeDependencyTests-554197803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.4648fa6e-254e-4f2e-848e-a0e845a534d1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:43 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.4648fa6e-254e-4f2e-848e-a0e845a534d1 Jul 03 01:26:43 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:43 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-046042d3-64e2-481f-9ff9-d7cefd3e4dbe Jul 03 01:26:43 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:44 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-735e70ed-a181-42dd-b60f-b7e00c7bc04b tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.920s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:44 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-735e70ed-a181-42dd-b60f-b7e00c7bc04b tempest-CreateVolumesFromSnapshotTest-332290763 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:26:44 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-735e70ed-a181-42dd-b60f-b7e00c7bc04b tempest-CreateVolumesFromSnapshotTest-332290763 None] Deleted volume successfully. Jul 03 01:26:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-735e70ed-a181-42dd-b60f-b7e00c7bc04b tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-5468ce3e-d29f-4f10-844e-770a12e71468-delete_volume" released by "delete_volume" :: held 3.166s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:44 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-01ab26d2-a5f6-4b04-b15c-0693fccd8165 tempest-VolumeDependencyTests-554197803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.4648fa6e-254e-4f2e-848e-a0e845a534d1" returned: 0 in 0.839s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:44 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-01ab26d2-a5f6-4b04-b15c-0693fccd8165 tempest-VolumeDependencyTests-554197803 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.4648fa6e-254e-4f2e-848e-a0e845a534d1 is being set with open permissions: ugo+rw Jul 03 01:26:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-01ab26d2-a5f6-4b04-b15c-0693fccd8165 tempest-VolumeDependencyTests-554197803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.4648fa6e-254e-4f2e-848e-a0e845a534d1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:44 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-97742a0e-991d-432a-8915-c21d9fe73da2 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-046042d3-64e2-481f-9ff9-d7cefd3e4dbe" returned: 0 in 0.916s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-97742a0e-991d-432a-8915-c21d9fe73da2 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-046042d3-64e2-481f-9ff9-d7cefd3e4dbe {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:44 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.4648fa6e-254e-4f2e-848e-a0e845a534d1 Jul 03 01:26:44 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:44 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-046042d3-64e2-481f-9ff9-d7cefd3e4dbe Jul 03 01:26:44 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:45 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-01ab26d2-a5f6-4b04-b15c-0693fccd8165 tempest-VolumeDependencyTests-554197803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.4648fa6e-254e-4f2e-848e-a0e845a534d1" returned: 0 in 0.685s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:45 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-97742a0e-991d-432a-8915-c21d9fe73da2 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-046042d3-64e2-481f-9ff9-d7cefd3e4dbe" returned: 0 in 0.686s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-97742a0e-991d-432a-8915-c21d9fe73da2 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-quobyte-046042d3-64e2-481f-9ff9-d7cefd3e4dbe" released by "delete_volume" :: held 1.672s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-01ab26d2-a5f6-4b04-b15c-0693fccd8165 tempest-VolumeDependencyTests-554197803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:45 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.info Jul 03 01:26:45 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:45 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-97742a0e-991d-432a-8915-c21d9fe73da2 tempest-CreateVolumesFromSnapshotTest-332290763 None] Created reservations ['92f2429b-8bf8-45d7-b7df-7e80af6ca187', '4e74faf0-9d51-4bf1-a109-590406e399cf', '31519e05-c585-4436-be30-32397bcd694f', '6e935eb2-2072-4b88-8724-39d92f6903df'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:26:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-97742a0e-991d-432a-8915-c21d9fe73da2 tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-97742a0e-991d-432a-8915-c21d9fe73da2 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-97742a0e-991d-432a-8915-c21d9fe73da2 tempest-CreateVolumesFromSnapshotTest-332290763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-97742a0e-991d-432a-8915-c21d9fe73da2 tempest-CreateVolumesFromSnapshotTest-332290763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-97742a0e-991d-432a-8915-c21d9fe73da2 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-97742a0e-991d-432a-8915-c21d9fe73da2 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:45 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:26:45 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-202ef32b-c59d-4f24-9bb5-575e622ef007 tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "cinder-bebff1ee-10b9-49b2-95e7-058f0e7dfd91-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-202ef32b-c59d-4f24-9bb5-575e622ef007 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-bebff1ee-10b9-49b2-95e7-058f0e7dfd91-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-202ef32b-c59d-4f24-9bb5-575e622ef007 tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "cinder-quobyte-bebff1ee-10b9-49b2-95e7-058f0e7dfd91" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-202ef32b-c59d-4f24-9bb5-575e622ef007 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-quobyte-bebff1ee-10b9-49b2-95e7-058f0e7dfd91" acquired by "delete_volume" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:45 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1797de-a172-4b7f-963e-14620a16e909]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-202ef32b-c59d-4f24-9bb5-575e622ef007 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bebff1ee-10b9-49b2-95e7-058f0e7dfd91 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:45 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bebff1ee-10b9-49b2-95e7-058f0e7dfd91 Jul 03 01:26:45 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:45 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-01ab26d2-a5f6-4b04-b15c-0693fccd8165 tempest-VolumeDependencyTests-554197803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.info" returned: 0 in 0.828s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:45 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-01ab26d2-a5f6-4b04-b15c-0693fccd8165 tempest-VolumeDependencyTests-554197803 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.info is being set with open permissions: ugo+rw Jul 03 01:26:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-01ab26d2-a5f6-4b04-b15c-0693fccd8165 tempest-VolumeDependencyTests-554197803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:46 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.info Jul 03 01:26:46 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:46 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-97742a0e-991d-432a-8915-c21d9fe73da2 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.744s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:46 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-97742a0e-991d-432a-8915-c21d9fe73da2 tempest-CreateVolumesFromSnapshotTest-332290763 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:26:46 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-97742a0e-991d-432a-8915-c21d9fe73da2 tempest-CreateVolumesFromSnapshotTest-332290763 None] Deleted volume successfully. Jul 03 01:26:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-97742a0e-991d-432a-8915-c21d9fe73da2 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-046042d3-64e2-481f-9ff9-d7cefd3e4dbe-delete_volume" released by "delete_volume" :: held 2.703s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:46 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-202ef32b-c59d-4f24-9bb5-575e622ef007 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bebff1ee-10b9-49b2-95e7-058f0e7dfd91" returned: 0 in 0.858s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-202ef32b-c59d-4f24-9bb5-575e622ef007 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bebff1ee-10b9-49b2-95e7-058f0e7dfd91 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:46 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-01ab26d2-a5f6-4b04-b15c-0693fccd8165 tempest-VolumeDependencyTests-554197803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.info" returned: 0 in 0.705s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:46 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bebff1ee-10b9-49b2-95e7-058f0e7dfd91 Jul 03 01:26:46 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-01ab26d2-a5f6-4b04-b15c-0693fccd8165 tempest-VolumeDependencyTests-554197803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.490s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.938s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d91bdfccee744a3909ebfd83139356b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:43Z,use_quota=True,user_id='84d684e3fd174d5fa404e41b07f67cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:26:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Creating volume 5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:26:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:26:46 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:26:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:46 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-01ab26d2-a5f6-4b04-b15c-0693fccd8165 tempest-VolumeDependencyTests-554197803 None] Create snapshot completed successfully Jul 03 01:26:46 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5 1073741824 Jul 03 01:26:46 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:47 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-202ef32b-c59d-4f24-9bb5-575e622ef007 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bebff1ee-10b9-49b2-95e7-058f0e7dfd91" returned: 0 in 0.683s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-202ef32b-c59d-4f24-9bb5-575e622ef007 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-quobyte-bebff1ee-10b9-49b2-95e7-058f0e7dfd91" released by "delete_volume" :: held 1.607s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:47 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-202ef32b-c59d-4f24-9bb5-575e622ef007 tempest-CreateVolumesFromSnapshotTest-332290763 None] Created reservations ['d6226968-37ba-4e59-97d5-199a2ff89f03', '7610c22b-0e85-40e4-9ba2-a5b9046fb3cc', '30085052-f0b8-4119-a584-b308271fc08f', 'b3751835-5d27-4343-aa42-669caee4337c'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:26:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-202ef32b-c59d-4f24-9bb5-575e622ef007 tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-202ef32b-c59d-4f24-9bb5-575e622ef007 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-202ef32b-c59d-4f24-9bb5-575e622ef007 tempest-CreateVolumesFromSnapshotTest-332290763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-202ef32b-c59d-4f24-9bb5-575e622ef007 tempest-CreateVolumesFromSnapshotTest-332290763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-202ef32b-c59d-4f24-9bb5-575e622ef007 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-202ef32b-c59d-4f24-9bb5-575e622ef007 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:47 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:26:47 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:47 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5 1073741824" returned: 0 in 0.948s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:47 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5 Jul 03 01:26:47 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a635a709-8071-4f6e-be7c-169dd2e41641 tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "cinder-7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a635a709-8071-4f6e-be7c-169dd2e41641 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a635a709-8071-4f6e-be7c-169dd2e41641 tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "cinder-quobyte-7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a635a709-8071-4f6e-be7c-169dd2e41641 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-quobyte-7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9" acquired by "delete_volume" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[348edb2e-9041-4645-99c2-5a0cf1a0c758]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a635a709-8071-4f6e-be7c-169dd2e41641 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:48 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9 Jul 03 01:26:48 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:48 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-202ef32b-c59d-4f24-9bb5-575e622ef007 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.825s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-202ef32b-c59d-4f24-9bb5-575e622ef007 tempest-CreateVolumesFromSnapshotTest-332290763 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:26:48 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-202ef32b-c59d-4f24-9bb5-575e622ef007 tempest-CreateVolumesFromSnapshotTest-332290763 None] Deleted volume successfully. Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-202ef32b-c59d-4f24-9bb5-575e622ef007 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-bebff1ee-10b9-49b2-95e7-058f0e7dfd91-delete_volume" released by "delete_volume" :: held 2.729s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Flow 'volume_create_manager' (17aaa793-d156-4258-b603-5c03ca5f0747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cacd4bdd-ab5a-4960-b849-4702c092974a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cacd4bdd-ab5a-4960-b849-4702c092974a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1081951752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09e8941e-6646-4478-9635-9090e7337675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e1ebe9ddf148218d1860659c291c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4648fa6e-254e-4f2e-848e-a0e845a534d1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:48Z,use_quota=True,user_id='5291f1374f4a4b9cb68e51ed3f6cbc95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6be7611b-400e-4183-bb46-56c77aa797ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6be7611b-400e-4183-bb46-56c77aa797ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:48 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767769d2-56c9-4f05-ac9c-4aa3875b50fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767769d2-56c9-4f05-ac9c-4aa3875b50fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '09e8941e-6646-4478-9635-9090e7337675', 'volume_name': 'volume-09e8941e-6646-4478-9635-9090e7337675', 'volume_size': 1, 'snapshot_id': '4648fa6e-254e-4f2e-848e-a0e845a534d1'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46cc9e9f-e4a6-49e2-87a6-91148247b5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46cc9e9f-e4a6-49e2-87a6-91148247b5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256824f0-2dc2-4e8b-bdf0-8a00c42ca40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:48 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Volume 09e8941e-6646-4478-9635-9090e7337675: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-09e8941e-6646-4478-9635-9090e7337675', 'volume_size': 1, 'snapshot_id': '4648fa6e-254e-4f2e-848e-a0e845a534d1'} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5" returned: 0 in 0.961s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] <== create_volume: return (1958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.963s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Acquiring lock "cinder-quobyte-4648fa6e-254e-4f2e-848e-a0e845a534d1-09e8941e-6646-4478-9635-9090e7337675" by "_create_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd9e8ca8-4c79-4246-a1ca-370be5b03c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a3572c-5a75-41d9-9d6f-9e92845214bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:48 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Volume volume-5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5 (5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5): created successfully Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a3572c-5a75-41d9-9d6f-9e92845214bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Flow 'volume_create_manager' (9a8b0d6b-be8c-4be4-94de-bf1318adfbd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Lock "cinder-quobyte-4648fa6e-254e-4f2e-848e-a0e845a534d1-09e8941e-6646-4478-9635-9090e7337675" acquired by "_create_volume_from_snapshot" :: waited 0.052s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Creating volume 09e8941e-6646-4478-9635-9090e7337675 from snapshot 4648fa6e-254e-4f2e-848e-a0e845a534d1 {{(pid=86772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Acquiring lock "cinder-quobyte-09e8941e-6646-4478-9635-9090e7337675" by "_copy_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:48 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1a7dc5aa-4568-4edb-ab3f-d0564c9b36bf tempest-CinderUnicodeTest-1349231317 None] Created volume successfully. Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Lock "cinder-quobyte-09e8941e-6646-4478-9635-9090e7337675" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] snapshot: 4648fa6e-254e-4f2e-848e-a0e845a534d1, volume: 09e8941e-6646-4478-9635-9090e7337675, {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[214ecc2d-e575-45bd-b4c9-f1e1e061b3bb]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.4648fa6e-254e-4f2e-848e-a0e845a534d1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:48 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.4648fa6e-254e-4f2e-848e-a0e845a534d1 Jul 03 01:26:48 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:49 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a635a709-8071-4f6e-be7c-169dd2e41641 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9" returned: 0 in 0.997s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a635a709-8071-4f6e-be7c-169dd2e41641 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:49 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9 Jul 03 01:26:49 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:49 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.4648fa6e-254e-4f2e-848e-a0e845a534d1" returned: 0 in 1.031s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:26:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 01:26:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Creating direct copy from snapshot {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 01:26:49 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[590dd9e3-c936-4549-bd97-6487dad4a76b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:26:50 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a Jul 03 01:26:50 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Flow 'volume_create_manager' (9c6fed2f-8752-4e1b-b6e0-723dd159e50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:50 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae88049c-1018-4234-b6d7-fa45f678f658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a635a709-8071-4f6e-be7c-169dd2e41641 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9" returned: 0 in 0.908s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae88049c-1018-4234-b6d7-fa45f678f658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1473218956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e7434f8-e383-4373-9d5e-505b727c25f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d91bdfccee744a3909ebfd83139356b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:50Z,use_quota=True,user_id='84d684e3fd174d5fa404e41b07f67cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (563a7499-345a-4594-ab4d-88e1813af5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (563a7499-345a-4594-ab4d-88e1813af5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55456b0b-4a68-4bd9-be51-fc8e71ba7725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55456b0b-4a68-4bd9-be51-fc8e71ba7725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e7434f8-e383-4373-9d5e-505b727c25f2', 'volume_name': 'volume-2e7434f8-e383-4373-9d5e-505b727c25f2', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98edf34e-ee36-4944-9cbc-9dd72f2fc58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98edf34e-ee36-4944-9cbc-9dd72f2fc58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1cef043-dc36-46e6-a0f0-ea82238760d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:50 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Volume 2e7434f8-e383-4373-9d5e-505b727c25f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e7434f8-e383-4373-9d5e-505b727c25f2', 'volume_size': 1} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a635a709-8071-4f6e-be7c-169dd2e41641 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-quobyte-7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9" released by "delete_volume" :: held 2.016s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-a635a709-8071-4f6e-be7c-169dd2e41641 tempest-CreateVolumesFromSnapshotTest-332290763 None] Created reservations ['f288e2c8-df24-4af5-87eb-c66c6c505fb1', '0caf4bdf-68f9-4b72-9e99-2473305fbbc4', 'c8233b0e-958b-424d-9f32-75326b9a1f98', '861778a2-50bf-42fe-a3ce-c4c9781fcb77'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a635a709-8071-4f6e-be7c-169dd2e41641 tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a635a709-8071-4f6e-be7c-169dd2e41641 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a635a709-8071-4f6e-be7c-169dd2e41641 tempest-CreateVolumesFromSnapshotTest-332290763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a635a709-8071-4f6e-be7c-169dd2e41641 tempest-CreateVolumesFromSnapshotTest-332290763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a635a709-8071-4f6e-be7c-169dd2e41641 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a635a709-8071-4f6e-be7c-169dd2e41641 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:50 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:26:50 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3011afd1-c94f-4e7f-a539-479dc0ea96da tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "cinder-895ada74-e324-41b8-a70a-d529f7bee574-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3011afd1-c94f-4e7f-a539-479dc0ea96da tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-895ada74-e324-41b8-a70a-d529f7bee574-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3011afd1-c94f-4e7f-a539-479dc0ea96da tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "cinder-quobyte-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3011afd1-c94f-4e7f-a539-479dc0ea96da tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-quobyte-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3011afd1-c94f-4e7f-a539-479dc0ea96da tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "cinder-quobyte-895ada74-e324-41b8-a70a-d529f7bee574" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3011afd1-c94f-4e7f-a539-479dc0ea96da tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-quobyte-895ada74-e324-41b8-a70a-d529f7bee574" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3011afd1-c94f-4e7f-a539-479dc0ea96da tempest-CreateVolumesFromSnapshotTest-332290763 None] Deleting offline snapshot 895ada74-e324-41b8-a70a-d529f7bee574 of volume bd5c8c17-bfda-48de-ae8e-92ac4cffcd66 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3011afd1-c94f-4e7f-a539-479dc0ea96da tempest-CreateVolumesFromSnapshotTest-332290763 None] snapshot_file for this snap is: volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.895ada74-e324-41b8-a70a-d529f7bee574 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae21772b-7c2c-439d-9c93-6eccada357f3]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3011afd1-c94f-4e7f-a539-479dc0ea96da tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.895ada74-e324-41b8-a70a-d529f7bee574 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:50 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.895ada74-e324-41b8-a70a-d529f7bee574 Jul 03 01:26:50 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:50 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a" returned: 0 in 1.002s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG cinder.utils [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Path /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09e8941e-6646-4478-9635-9090e7337675 not found in is_blk_device check {{(pid=86772) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 01:26:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09e8941e-6646-4478-9635-9090e7337675 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:50 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09e8941e-6646-4478-9635-9090e7337675 Jul 03 01:26:50 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:51 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a635a709-8071-4f6e-be7c-169dd2e41641 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.863s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:51 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-a635a709-8071-4f6e-be7c-169dd2e41641 tempest-CreateVolumesFromSnapshotTest-332290763 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:26:51 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a635a709-8071-4f6e-be7c-169dd2e41641 tempest-CreateVolumesFromSnapshotTest-332290763 None] Deleted volume successfully. Jul 03 01:26:51 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a635a709-8071-4f6e-be7c-169dd2e41641 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-7c3aafa8-36c4-4dc2-bb6d-86e129b9f1b9-delete_volume" released by "delete_volume" :: held 3.119s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:51 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3011afd1-c94f-4e7f-a539-479dc0ea96da tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.895ada74-e324-41b8-a70a-d529f7bee574" returned: 0 in 0.842s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:51 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3011afd1-c94f-4e7f-a539-479dc0ea96da tempest-CreateVolumesFromSnapshotTest-332290763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:26:51 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[09af1b0e-92f2-4d40-bf24-32bb998cb27b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3011afd1-c94f-4e7f-a539-479dc0ea96da tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:51 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66 Jul 03 01:26:51 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:53 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3011afd1-c94f-4e7f-a539-479dc0ea96da tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66" returned: 0 in 1.573s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3011afd1-c94f-4e7f-a539-479dc0ea96da tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.895ada74-e324-41b8-a70a-d529f7bee574 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:53 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.895ada74-e324-41b8-a70a-d529f7bee574 Jul 03 01:26:53 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:55 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3011afd1-c94f-4e7f-a539-479dc0ea96da tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.895ada74-e324-41b8-a70a-d529f7bee574" returned: 0 in 2.560s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3011afd1-c94f-4e7f-a539-479dc0ea96da tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.895ada74-e324-41b8-a70a-d529f7bee574 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:55 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.895ada74-e324-41b8-a70a-d529f7bee574 Jul 03 01:26:55 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:56 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09e8941e-6646-4478-9635-9090e7337675" returned: 0 in 5.711s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:56 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bbc8fc-499e-44ec-a9f6-b34ca6702447]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:56 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a Jul 03 01:26:56 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:56 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3011afd1-c94f-4e7f-a539-479dc0ea96da tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66.895ada74-e324-41b8-a70a-d529f7bee574" returned: 0 in 1.233s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3011afd1-c94f-4e7f-a539-479dc0ea96da tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-quobyte-895ada74-e324-41b8-a70a-d529f7bee574" released by "_delete_snapshot" :: held 6.368s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3011afd1-c94f-4e7f-a539-479dc0ea96da tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-quobyte-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66" released by "delete_snapshot" :: held 6.413s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:57 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-3011afd1-c94f-4e7f-a539-479dc0ea96da tempest-CreateVolumesFromSnapshotTest-332290763 None] Created reservations ['e9e1c951-87fd-4eca-b09e-a500f627da3f', '0ca0cc32-4464-4213-bda6-e3a58c1846bf', '4305bc4e-72ed-4530-9398-82966f8e6111', '71605908-31c9-4525-8ab6-93c489268e26'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:26:57 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3011afd1-c94f-4e7f-a539-479dc0ea96da tempest-CreateVolumesFromSnapshotTest-332290763 None] Delete snapshot completed successfully. Jul 03 01:26:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3011afd1-c94f-4e7f-a539-479dc0ea96da tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-895ada74-e324-41b8-a70a-d529f7bee574-delete_snapshot" released by "delete_snapshot" :: held 6.596s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:57 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a" returned: 0 in 0.989s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:57 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Image conversion details: src /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a, size 1024.00 MB, duration 5.71 sec, destination /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09e8941e-6646-4478-9635-9090e7337675 {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:26:57 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Converted 1024.00 MB image at 179.25 MB/s Jul 03 01:26:57 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09e8941e-6646-4478-9635-9090e7337675 is being set with open permissions: ugo+rw Jul 03 01:26:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09e8941e-6646-4478-9635-9090e7337675 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:57 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09e8941e-6646-4478-9635-9090e7337675 Jul 03 01:26:57 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e2daff81-6839-4f3a-a87f-7e0e3a2a5d23 tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "cinder-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e2daff81-6839-4f3a-a87f-7e0e3a2a5d23 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e2daff81-6839-4f3a-a87f-7e0e3a2a5d23 tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "cinder-quobyte-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e2daff81-6839-4f3a-a87f-7e0e3a2a5d23 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-quobyte-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:58 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dfd1e8-2f75-4883-bc2c-e37ff7a202ea]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2daff81-6839-4f3a-a87f-7e0e3a2a5d23 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:58 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09e8941e-6646-4478-9635-9090e7337675" returned: 0 in 0.678s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Lock "cinder-quobyte-09e8941e-6646-4478-9635-9090e7337675" released by "_copy_volume_from_snapshot" :: held 9.543s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Lock "cinder-quobyte-4648fa6e-254e-4f2e-848e-a0e845a534d1-09e8941e-6646-4478-9635-9090e7337675" released by "_create_volume_from_snapshot" :: held 9.599s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:26:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.655s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.229s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:58 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:26:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1473218956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e7434f8-e383-4373-9d5e-505b727c25f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d91bdfccee744a3909ebfd83139356b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:26:50Z,use_quota=True,user_id='84d684e3fd174d5fa404e41b07f67cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:26:58 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Creating volume 2e7434f8-e383-4373-9d5e-505b727c25f2 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:26:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:26:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:26:58 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:26:58 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:26:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:26:58 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:26:58 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:26:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:58 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66 Jul 03 01:26:58 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:58 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2 1073741824 Jul 03 01:26:58 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256824f0-2dc2-4e8b-bdf0-8a00c42ca40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09e8941e-6646-4478-9635-9090e7337675', 'volume_size': 1, 'snapshot_id': '4648fa6e-254e-4f2e-848e-a0e845a534d1'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9e04e8-9428-4018-ab70-e0bd288b97f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:26:58 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Volume volume-09e8941e-6646-4478-9635-9090e7337675 (09e8941e-6646-4478-9635-9090e7337675): created successfully Jul 03 01:26:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9e04e8-9428-4018-ab70-e0bd288b97f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:26:58 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Flow 'volume_create_manager' (17aaa793-d156-4258-b603-5c03ca5f0747) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:26:58 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-2498eadc-5c45-4508-8330-665877cbc568 tempest-VolumeDependencyTests-554197803 None] Created volume successfully. Jul 03 01:26:59 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2daff81-6839-4f3a-a87f-7e0e3a2a5d23 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66" returned: 0 in 0.893s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2daff81-6839-4f3a-a87f-7e0e3a2a5d23 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:59 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66 Jul 03 01:26:59 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:59 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Jul 03 01:26:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2 1073741824" returned: 0 in 0.994s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:26:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:26:59 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2 Jul 03 01:26:59 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:26:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-62c67775-0b73-4670-99e2-e9974fdc8356 tempest-VolumeDependencyTests-554197803 None] Acquiring lock "cinder-4648fa6e-254e-4f2e-848e-a0e845a534d1-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-62c67775-0b73-4670-99e2-e9974fdc8356 tempest-VolumeDependencyTests-554197803 None] Lock "cinder-4648fa6e-254e-4f2e-848e-a0e845a534d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-62c67775-0b73-4670-99e2-e9974fdc8356 tempest-VolumeDependencyTests-554197803 None] Acquiring lock "cinder-quobyte-759d8a76-6a04-43dd-8cf1-5363bcadc07a" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-62c67775-0b73-4670-99e2-e9974fdc8356 tempest-VolumeDependencyTests-554197803 None] Lock "cinder-quobyte-759d8a76-6a04-43dd-8cf1-5363bcadc07a" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-62c67775-0b73-4670-99e2-e9974fdc8356 tempest-VolumeDependencyTests-554197803 None] Acquiring lock "cinder-quobyte-4648fa6e-254e-4f2e-848e-a0e845a534d1" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:26:59 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-62c67775-0b73-4670-99e2-e9974fdc8356 tempest-VolumeDependencyTests-554197803 None] Lock "cinder-quobyte-4648fa6e-254e-4f2e-848e-a0e845a534d1" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:26:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-62c67775-0b73-4670-99e2-e9974fdc8356 tempest-VolumeDependencyTests-554197803 None] Deleting offline snapshot 4648fa6e-254e-4f2e-848e-a0e845a534d1 of volume 759d8a76-6a04-43dd-8cf1-5363bcadc07a {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:26:59 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-62c67775-0b73-4670-99e2-e9974fdc8356 tempest-VolumeDependencyTests-554197803 None] snapshot_file for this snap is: volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.4648fa6e-254e-4f2e-848e-a0e845a534d1 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:26:59 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45b85cb-638d-479e-bc26-e21360648691]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:26:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-62c67775-0b73-4670-99e2-e9974fdc8356 tempest-VolumeDependencyTests-554197803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.4648fa6e-254e-4f2e-848e-a0e845a534d1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:00 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.4648fa6e-254e-4f2e-848e-a0e845a534d1 Jul 03 01:27:00 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:00 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2daff81-6839-4f3a-a87f-7e0e3a2a5d23 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66" returned: 0 in 0.914s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e2daff81-6839-4f3a-a87f-7e0e3a2a5d23 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-quobyte-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66" released by "delete_volume" :: held 1.892s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:00 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e2daff81-6839-4f3a-a87f-7e0e3a2a5d23 tempest-CreateVolumesFromSnapshotTest-332290763 None] Created reservations ['119a6267-648f-4e16-a14a-673485e88b9f', '72e3bf6e-6cba-4563-82d4-232ed23d57f6', '4da769f0-3b2f-4399-83a5-e116d5bfc5e4', 'f12c8152-99c5-4da2-ae1c-1bf78645b6f3'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:00 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2" returned: 0 in 0.810s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] <== create_volume: return (1856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1cef043-dc36-46e6-a0f0-ea82238760d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e7434f8-e383-4373-9d5e-505b727c25f2', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (456e6297-6f07-494b-8fe7-040b61541ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:00 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Volume volume-2e7434f8-e383-4373-9d5e-505b727c25f2 (2e7434f8-e383-4373-9d5e-505b727c25f2): created successfully Jul 03 01:27:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (456e6297-6f07-494b-8fe7-040b61541ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:00 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Flow 'volume_create_manager' (9c6fed2f-8752-4e1b-b6e0-723dd159e50a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:00 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-000bd44c-164f-4a3b-9da5-2b88afeda181 tempest-CinderUnicodeTest-1349231317 None] Created volume successfully. Jul 03 01:27:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e2daff81-6839-4f3a-a87f-7e0e3a2a5d23 tempest-CreateVolumesFromSnapshotTest-332290763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e2daff81-6839-4f3a-a87f-7e0e3a2a5d23 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e2daff81-6839-4f3a-a87f-7e0e3a2a5d23 tempest-CreateVolumesFromSnapshotTest-332290763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e2daff81-6839-4f3a-a87f-7e0e3a2a5d23 tempest-CreateVolumesFromSnapshotTest-332290763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e2daff81-6839-4f3a-a87f-7e0e3a2a5d23 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2daff81-6839-4f3a-a87f-7e0e3a2a5d23 tempest-CreateVolumesFromSnapshotTest-332290763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:00 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:27:00 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:00 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-62c67775-0b73-4670-99e2-e9974fdc8356 tempest-VolumeDependencyTests-554197803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.4648fa6e-254e-4f2e-848e-a0e845a534d1" returned: 0 in 0.981s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-62c67775-0b73-4670-99e2-e9974fdc8356 tempest-VolumeDependencyTests-554197803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:27:00 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8316246a-27ee-4180-a9f3-fceba28db051]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-62c67775-0b73-4670-99e2-e9974fdc8356 tempest-VolumeDependencyTests-554197803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:01 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a Jul 03 01:27:01 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:01 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2daff81-6839-4f3a-a87f-7e0e3a2a5d23 tempest-CreateVolumesFromSnapshotTest-332290763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.836s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:01 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-e2daff81-6839-4f3a-a87f-7e0e3a2a5d23 tempest-CreateVolumesFromSnapshotTest-332290763 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e2daff81-6839-4f3a-a87f-7e0e3a2a5d23 tempest-CreateVolumesFromSnapshotTest-332290763 None] Deleted volume successfully. Jul 03 01:27:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e2daff81-6839-4f3a-a87f-7e0e3a2a5d23 tempest-CreateVolumesFromSnapshotTest-332290763 None] Lock "cinder-bd5c8c17-bfda-48de-ae8e-92ac4cffcd66-delete_volume" released by "delete_volume" :: held 3.084s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6e54973b-fed1-4ff8-ac72-d9ec4e68696a tempest-CinderUnicodeTest-1349231317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6e54973b-fed1-4ff8-ac72-d9ec4e68696a tempest-CinderUnicodeTest-1349231317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6e54973b-fed1-4ff8-ac72-d9ec4e68696a tempest-CinderUnicodeTest-1349231317 None] Creating offline snapshot e3f9d735-9387-4ff8-b10b-74284f3b37da of volume 2e7434f8-e383-4373-9d5e-505b727c25f2 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:27:01 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e8cf9e-14a2-46ba-9c05-98c7f1a8f932]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e54973b-fed1-4ff8-ac72-d9ec4e68696a tempest-CinderUnicodeTest-1349231317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:01 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2 Jul 03 01:27:01 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:01 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-62c67775-0b73-4670-99e2-e9974fdc8356 tempest-VolumeDependencyTests-554197803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a" returned: 0 in 1.023s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-62c67775-0b73-4670-99e2-e9974fdc8356 tempest-VolumeDependencyTests-554197803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.4648fa6e-254e-4f2e-848e-a0e845a534d1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:01 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.4648fa6e-254e-4f2e-848e-a0e845a534d1 Jul 03 01:27:01 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:02 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e54973b-fed1-4ff8-ac72-d9ec4e68696a tempest-CinderUnicodeTest-1349231317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2" returned: 0 in 1.087s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e54973b-fed1-4ff8-ac72-d9ec4e68696a tempest-CinderUnicodeTest-1349231317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2.e3f9d735-9387-4ff8-b10b-74284f3b37da 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:02 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2.e3f9d735-9387-4ff8-b10b-74284f3b37da 1G Jul 03 01:27:02 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:03 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-62c67775-0b73-4670-99e2-e9974fdc8356 tempest-VolumeDependencyTests-554197803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.4648fa6e-254e-4f2e-848e-a0e845a534d1" returned: 0 in 1.153s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-62c67775-0b73-4670-99e2-e9974fdc8356 tempest-VolumeDependencyTests-554197803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.4648fa6e-254e-4f2e-848e-a0e845a534d1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:03 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.4648fa6e-254e-4f2e-848e-a0e845a534d1 Jul 03 01:27:03 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:03 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e54973b-fed1-4ff8-ac72-d9ec4e68696a tempest-CinderUnicodeTest-1349231317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2.e3f9d735-9387-4ff8-b10b-74284f3b37da 1G" returned: 0 in 1.086s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e54973b-fed1-4ff8-ac72-d9ec4e68696a tempest-CinderUnicodeTest-1349231317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e7434f8-e383-4373-9d5e-505b727c25f2 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2.e3f9d735-9387-4ff8-b10b-74284f3b37da {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:03 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e7434f8-e383-4373-9d5e-505b727c25f2 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2.e3f9d735-9387-4ff8-b10b-74284f3b37da Jul 03 01:27:03 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:03 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-62c67775-0b73-4670-99e2-e9974fdc8356 tempest-VolumeDependencyTests-554197803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a.4648fa6e-254e-4f2e-848e-a0e845a534d1" returned: 0 in 0.871s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-62c67775-0b73-4670-99e2-e9974fdc8356 tempest-VolumeDependencyTests-554197803 None] Lock "cinder-quobyte-4648fa6e-254e-4f2e-848e-a0e845a534d1" released by "_delete_snapshot" :: held 4.194s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-62c67775-0b73-4670-99e2-e9974fdc8356 tempest-VolumeDependencyTests-554197803 None] Lock "cinder-quobyte-759d8a76-6a04-43dd-8cf1-5363bcadc07a" released by "delete_snapshot" :: held 4.249s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:04 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-62c67775-0b73-4670-99e2-e9974fdc8356 tempest-VolumeDependencyTests-554197803 None] Created reservations ['98f6fd65-699d-49c6-a6b0-38ba83f85b85', '0877a270-78dd-4207-b788-3906fb2ccf12', '6cf1b97d-483f-408a-9545-459b06f25080', 'dc861590-5f66-4ed6-9110-d0e3e7429d65'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:04 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-62c67775-0b73-4670-99e2-e9974fdc8356 tempest-VolumeDependencyTests-554197803 None] Delete snapshot completed successfully. Jul 03 01:27:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-62c67775-0b73-4670-99e2-e9974fdc8356 tempest-VolumeDependencyTests-554197803 None] Lock "cinder-4648fa6e-254e-4f2e-848e-a0e845a534d1-delete_snapshot" released by "delete_snapshot" :: held 4.466s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:04 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e54973b-fed1-4ff8-ac72-d9ec4e68696a tempest-CinderUnicodeTest-1349231317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e7434f8-e383-4373-9d5e-505b727c25f2 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2.e3f9d735-9387-4ff8-b10b-74284f3b37da" returned: 0 in 0.808s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:04 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-6e54973b-fed1-4ff8-ac72-d9ec4e68696a tempest-CinderUnicodeTest-1349231317 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2.e3f9d735-9387-4ff8-b10b-74284f3b37da is being set with open permissions: ugo+rw Jul 03 01:27:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e54973b-fed1-4ff8-ac72-d9ec4e68696a tempest-CinderUnicodeTest-1349231317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2.e3f9d735-9387-4ff8-b10b-74284f3b37da {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:04 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2.e3f9d735-9387-4ff8-b10b-74284f3b37da Jul 03 01:27:04 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:04 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Flow 'volume_create_manager' (c0824c23-6ca7-4409-805c-ef7fb752790d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a36cee80-780d-4419-b953-6c1bb9595465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a36cee80-780d-4419-b953-6c1bb9595465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-197633132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ab807c-560a-4bd4-a57c-f42cbf9e4548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeec64327648414485ea3961a11fcffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:05Z,use_quota=True,user_id='98f8221462e542caa1f9e0a370cf159a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92739e10-f272-4546-abae-9b6e7f68e8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92739e10-f272-4546-abae-9b6e7f68e8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad124d3e-92f6-44d1-b0ad-af262b0d6906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad124d3e-92f6-44d1-b0ad-af262b0d6906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87ab807c-560a-4bd4-a57c-f42cbf9e4548', 'volume_name': 'volume-87ab807c-560a-4bd4-a57c-f42cbf9e4548', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03815879-edef-4043-968d-7d1b4e2add93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03815879-edef-4043-968d-7d1b4e2add93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf9e453-a1b7-4a9d-9d48-9e17c8c0bbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:04 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Volume 87ab807c-560a-4bd4-a57c-f42cbf9e4548: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87ab807c-560a-4bd4-a57c-f42cbf9e4548', 'volume_size': 1} Jul 03 01:27:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-57a541aa-493d-4e22-903d-5dfa6a4def00 tempest-VolumeDependencyTests-554197803 None] Acquiring lock "cinder-759d8a76-6a04-43dd-8cf1-5363bcadc07a-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-57a541aa-493d-4e22-903d-5dfa6a4def00 tempest-VolumeDependencyTests-554197803 None] Lock "cinder-759d8a76-6a04-43dd-8cf1-5363bcadc07a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-57a541aa-493d-4e22-903d-5dfa6a4def00 tempest-VolumeDependencyTests-554197803 None] Acquiring lock "cinder-quobyte-759d8a76-6a04-43dd-8cf1-5363bcadc07a" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-57a541aa-493d-4e22-903d-5dfa6a4def00 tempest-VolumeDependencyTests-554197803 None] Lock "cinder-quobyte-759d8a76-6a04-43dd-8cf1-5363bcadc07a" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:05 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2024cc2d-a3d7-4c2c-bec9-92bf6bfd9d52]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-57a541aa-493d-4e22-903d-5dfa6a4def00 tempest-VolumeDependencyTests-554197803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:05 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e54973b-fed1-4ff8-ac72-d9ec4e68696a tempest-CinderUnicodeTest-1349231317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2.e3f9d735-9387-4ff8-b10b-74284f3b37da" returned: 0 in 0.783s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e54973b-fed1-4ff8-ac72-d9ec4e68696a tempest-CinderUnicodeTest-1349231317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:05 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2.info Jul 03 01:27:05 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:05 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a Jul 03 01:27:05 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:06 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e54973b-fed1-4ff8-ac72-d9ec4e68696a tempest-CinderUnicodeTest-1349231317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2.info" returned: 0 in 0.769s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:06 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-6e54973b-fed1-4ff8-ac72-d9ec4e68696a tempest-CinderUnicodeTest-1349231317 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2.info is being set with open permissions: ugo+rw Jul 03 01:27:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e54973b-fed1-4ff8-ac72-d9ec4e68696a tempest-CinderUnicodeTest-1349231317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:06 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-57a541aa-493d-4e22-903d-5dfa6a4def00 tempest-VolumeDependencyTests-554197803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a" returned: 0 in 0.892s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-57a541aa-493d-4e22-903d-5dfa6a4def00 tempest-VolumeDependencyTests-554197803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:06 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2.info Jul 03 01:27:06 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:06 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a Jul 03 01:27:06 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:06 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6e54973b-fed1-4ff8-ac72-d9ec4e68696a tempest-CinderUnicodeTest-1349231317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2.info" returned: 0 in 0.693s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6e54973b-fed1-4ff8-ac72-d9ec4e68696a tempest-CinderUnicodeTest-1349231317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.374s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.116s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-197633132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ab807c-560a-4bd4-a57c-f42cbf9e4548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeec64327648414485ea3961a11fcffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:05Z,use_quota=True,user_id='98f8221462e542caa1f9e0a370cf159a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Creating volume 87ab807c-560a-4bd4-a57c-f42cbf9e4548 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:06 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:27:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-87ab807c-560a-4bd4-a57c-f42cbf9e4548 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:06 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:06 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=136,cinder:UPDATE=167,cinder:DELETE=15,cinder:INSERT=53 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:27:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-57a541aa-493d-4e22-903d-5dfa6a4def00 tempest-VolumeDependencyTests-554197803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-759d8a76-6a04-43dd-8cf1-5363bcadc07a" returned: 0 in 0.728s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:06 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-87ab807c-560a-4bd4-a57c-f42cbf9e4548 1073741824 Jul 03 01:27:06 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-57a541aa-493d-4e22-903d-5dfa6a4def00 tempest-VolumeDependencyTests-554197803 None] Lock "cinder-quobyte-759d8a76-6a04-43dd-8cf1-5363bcadc07a" released by "delete_volume" :: held 1.697s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:06 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6e54973b-fed1-4ff8-ac72-d9ec4e68696a tempest-CinderUnicodeTest-1349231317 None] Create snapshot completed successfully Jul 03 01:27:06 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-57a541aa-493d-4e22-903d-5dfa6a4def00 tempest-VolumeDependencyTests-554197803 None] Created reservations ['a40e1eb4-b732-41ef-99ac-6dc92c0658d3', '6f472a37-e0dd-43dd-b372-84bdb1f98927', '437a057b-b3b0-4a36-975f-b490c878871d', 'beddc39c-3b2e-4013-8e3f-5c78fcc5e2d5'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-57a541aa-493d-4e22-903d-5dfa6a4def00 tempest-VolumeDependencyTests-554197803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-57a541aa-493d-4e22-903d-5dfa6a4def00 tempest-VolumeDependencyTests-554197803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-57a541aa-493d-4e22-903d-5dfa6a4def00 tempest-VolumeDependencyTests-554197803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:07 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-57a541aa-493d-4e22-903d-5dfa6a4def00 tempest-VolumeDependencyTests-554197803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-57a541aa-493d-4e22-903d-5dfa6a4def00 tempest-VolumeDependencyTests-554197803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-57a541aa-493d-4e22-903d-5dfa6a4def00 tempest-VolumeDependencyTests-554197803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:07 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:27:07 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1b6ba5d5-80ec-44df-9c6d-a2ac3618fa8b tempest-VolumeDependencyTests-554197803 None] Acquiring lock "cinder-09e8941e-6646-4478-9635-9090e7337675-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1b6ba5d5-80ec-44df-9c6d-a2ac3618fa8b tempest-VolumeDependencyTests-554197803 None] Lock "cinder-09e8941e-6646-4478-9635-9090e7337675-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1b6ba5d5-80ec-44df-9c6d-a2ac3618fa8b tempest-VolumeDependencyTests-554197803 None] Acquiring lock "cinder-quobyte-09e8941e-6646-4478-9635-9090e7337675" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1b6ba5d5-80ec-44df-9c6d-a2ac3618fa8b tempest-VolumeDependencyTests-554197803 None] Lock "cinder-quobyte-09e8941e-6646-4478-9635-9090e7337675" acquired by "delete_volume" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:07 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcaa227-75df-4c0c-92ee-dda9ff22434b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1b6ba5d5-80ec-44df-9c6d-a2ac3618fa8b tempest-VolumeDependencyTests-554197803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09e8941e-6646-4478-9635-9090e7337675 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:07 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09e8941e-6646-4478-9635-9090e7337675 Jul 03 01:27:07 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3d361dc5-72c5-4240-ac80-84dcbea62f4a tempest-CinderUnicodeTest-1349231317 None] Acquiring lock "cinder-e3f9d735-9387-4ff8-b10b-74284f3b37da-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3d361dc5-72c5-4240-ac80-84dcbea62f4a tempest-CinderUnicodeTest-1349231317 None] Lock "cinder-e3f9d735-9387-4ff8-b10b-74284f3b37da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3d361dc5-72c5-4240-ac80-84dcbea62f4a tempest-CinderUnicodeTest-1349231317 None] Acquiring lock "cinder-quobyte-2e7434f8-e383-4373-9d5e-505b727c25f2" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3d361dc5-72c5-4240-ac80-84dcbea62f4a tempest-CinderUnicodeTest-1349231317 None] Lock "cinder-quobyte-2e7434f8-e383-4373-9d5e-505b727c25f2" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:07 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3d361dc5-72c5-4240-ac80-84dcbea62f4a tempest-CinderUnicodeTest-1349231317 None] Acquiring lock "cinder-quobyte-e3f9d735-9387-4ff8-b10b-74284f3b37da" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3d361dc5-72c5-4240-ac80-84dcbea62f4a tempest-CinderUnicodeTest-1349231317 None] Lock "cinder-quobyte-e3f9d735-9387-4ff8-b10b-74284f3b37da" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3d361dc5-72c5-4240-ac80-84dcbea62f4a tempest-CinderUnicodeTest-1349231317 None] Deleting offline snapshot e3f9d735-9387-4ff8-b10b-74284f3b37da of volume 2e7434f8-e383-4373-9d5e-505b727c25f2 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:27:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3d361dc5-72c5-4240-ac80-84dcbea62f4a tempest-CinderUnicodeTest-1349231317 None] snapshot_file for this snap is: volume-2e7434f8-e383-4373-9d5e-505b727c25f2.e3f9d735-9387-4ff8-b10b-74284f3b37da {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:27:08 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d0ae90-0b59-4238-9b6d-3d4e575c3780]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d361dc5-72c5-4240-ac80-84dcbea62f4a tempest-CinderUnicodeTest-1349231317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2.e3f9d735-9387-4ff8-b10b-74284f3b37da {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:08 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-57a541aa-493d-4e22-903d-5dfa6a4def00 tempest-VolumeDependencyTests-554197803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.057s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:08 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-57a541aa-493d-4e22-903d-5dfa6a4def00 tempest-VolumeDependencyTests-554197803 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:08 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-57a541aa-493d-4e22-903d-5dfa6a4def00 tempest-VolumeDependencyTests-554197803 None] Deleted volume successfully. Jul 03 01:27:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-57a541aa-493d-4e22-903d-5dfa6a4def00 tempest-VolumeDependencyTests-554197803 None] Lock "cinder-759d8a76-6a04-43dd-8cf1-5363bcadc07a-delete_volume" released by "delete_volume" :: held 3.129s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:08 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2.e3f9d735-9387-4ff8-b10b-74284f3b37da Jul 03 01:27:08 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:08 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-87ab807c-560a-4bd4-a57c-f42cbf9e4548 1073741824" returned: 0 in 1.592s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:08 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=189,cinder:SELECT=140,cinder:INSERT=46,cinder:DELETE=18 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:27:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-87ab807c-560a-4bd4-a57c-f42cbf9e4548 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:08 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-87ab807c-560a-4bd4-a57c-f42cbf9e4548 Jul 03 01:27:08 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:08 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1b6ba5d5-80ec-44df-9c6d-a2ac3618fa8b tempest-VolumeDependencyTests-554197803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09e8941e-6646-4478-9635-9090e7337675" returned: 0 in 1.274s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1b6ba5d5-80ec-44df-9c6d-a2ac3618fa8b tempest-VolumeDependencyTests-554197803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09e8941e-6646-4478-9635-9090e7337675 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:08 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09e8941e-6646-4478-9635-9090e7337675 Jul 03 01:27:08 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:09 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-87ab807c-560a-4bd4-a57c-f42cbf9e4548" returned: 0 in 0.830s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] <== create_volume: return (2512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.515s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf9e453-a1b7-4a9d-9d48-9e17c8c0bbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87ab807c-560a-4bd4-a57c-f42cbf9e4548', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10cd47a3-97d8-40de-b83a-08e15dc59e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:09 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Volume volume-87ab807c-560a-4bd4-a57c-f42cbf9e4548 (87ab807c-560a-4bd4-a57c-f42cbf9e4548): created successfully Jul 03 01:27:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10cd47a3-97d8-40de-b83a-08e15dc59e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:09 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Flow 'volume_create_manager' (c0824c23-6ca7-4409-805c-ef7fb752790d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d361dc5-72c5-4240-ac80-84dcbea62f4a tempest-CinderUnicodeTest-1349231317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2.e3f9d735-9387-4ff8-b10b-74284f3b37da" returned: 0 in 1.358s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3d361dc5-72c5-4240-ac80-84dcbea62f4a tempest-CinderUnicodeTest-1349231317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e7434f8-e383-4373-9d5e-505b727c25f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:27:09 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-47cb2a93-5754-458d-910e-a90fa035ee24 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Created volume successfully. Jul 03 01:27:09 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6158f8-4a19-45d1-8df2-8d1fd51b30e5]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d361dc5-72c5-4240-ac80-84dcbea62f4a tempest-CinderUnicodeTest-1349231317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:09 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2 Jul 03 01:27:09 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:09 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1b6ba5d5-80ec-44df-9c6d-a2ac3618fa8b tempest-VolumeDependencyTests-554197803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-09e8941e-6646-4478-9635-9090e7337675" returned: 0 in 1.113s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1b6ba5d5-80ec-44df-9c6d-a2ac3618fa8b tempest-VolumeDependencyTests-554197803 None] Lock "cinder-quobyte-09e8941e-6646-4478-9635-9090e7337675" released by "delete_volume" :: held 2.465s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-1b6ba5d5-80ec-44df-9c6d-a2ac3618fa8b tempest-VolumeDependencyTests-554197803 None] Created reservations ['8f6acac9-4f6f-47fd-990a-25c02a5df34e', '4212e1d6-99ac-4ad7-b7eb-65a0e7312c8d', '241713e4-3baf-4010-989c-d59c2446fbc1', '86e226d2-7b42-4d27-9c98-c23dacafa030'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1b6ba5d5-80ec-44df-9c6d-a2ac3618fa8b tempest-VolumeDependencyTests-554197803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1b6ba5d5-80ec-44df-9c6d-a2ac3618fa8b tempest-VolumeDependencyTests-554197803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1b6ba5d5-80ec-44df-9c6d-a2ac3618fa8b tempest-VolumeDependencyTests-554197803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1b6ba5d5-80ec-44df-9c6d-a2ac3618fa8b tempest-VolumeDependencyTests-554197803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1b6ba5d5-80ec-44df-9c6d-a2ac3618fa8b tempest-VolumeDependencyTests-554197803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1b6ba5d5-80ec-44df-9c6d-a2ac3618fa8b tempest-VolumeDependencyTests-554197803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:10 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:27:10 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:10 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d361dc5-72c5-4240-ac80-84dcbea62f4a tempest-CinderUnicodeTest-1349231317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2" returned: 0 in 1.246s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d361dc5-72c5-4240-ac80-84dcbea62f4a tempest-CinderUnicodeTest-1349231317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2.e3f9d735-9387-4ff8-b10b-74284f3b37da {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:10 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2.e3f9d735-9387-4ff8-b10b-74284f3b37da Jul 03 01:27:10 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Flow 'volume_create_manager' (672f60e6-3f29-46d8-bb24-a1f9e6ccd3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349340c9-d50b-4b42-9281-87e4edd09ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349340c9-d50b-4b42-9281-87e4edd09ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-507029569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d23b94b-2df0-48a9-86dc-718b9fa15556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeec64327648414485ea3961a11fcffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:11Z,use_quota=True,user_id='98f8221462e542caa1f9e0a370cf159a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc290662-f0ed-44b8-8318-4fd67f673fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc290662-f0ed-44b8-8318-4fd67f673fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b481cc5-a2ec-4261-ac1b-373a83e56fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b481cc5-a2ec-4261-ac1b-373a83e56fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d23b94b-2df0-48a9-86dc-718b9fa15556', 'volume_name': 'volume-2d23b94b-2df0-48a9-86dc-718b9fa15556', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4076ab13-90ee-4359-a36f-b721f4e3a1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4076ab13-90ee-4359-a36f-b721f4e3a1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ba222d-8bbc-4c10-8399-5230920b6f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:10 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Volume 2d23b94b-2df0-48a9-86dc-718b9fa15556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d23b94b-2df0-48a9-86dc-718b9fa15556', 'volume_size': 1} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-507029569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d23b94b-2df0-48a9-86dc-718b9fa15556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeec64327648414485ea3961a11fcffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:11Z,use_quota=True,user_id='98f8221462e542caa1f9e0a370cf159a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Creating volume 2d23b94b-2df0-48a9-86dc-718b9fa15556 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:10 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:27:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d23b94b-2df0-48a9-86dc-718b9fa15556 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:10 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d23b94b-2df0-48a9-86dc-718b9fa15556 1073741824 Jul 03 01:27:10 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:11 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Flow 'volume_create_manager' (49304f25-48fd-49ae-a4a3-cde2f9bbb14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90d145a-d9b0-4f07-9fe0-fa6d87db27a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90d145a-d9b0-4f07-9fe0-fa6d87db27a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-826881046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a6ebc3a-d14a-44fb-95e3-fee69a31c250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeec64327648414485ea3961a11fcffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:11Z,use_quota=True,user_id='98f8221462e542caa1f9e0a370cf159a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd20190a-9628-4781-879e-0a0b26ce0b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd20190a-9628-4781-879e-0a0b26ce0b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c2d2a3-61da-4ff0-96d8-2d9f08575b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c2d2a3-61da-4ff0-96d8-2d9f08575b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a6ebc3a-d14a-44fb-95e3-fee69a31c250', 'volume_name': 'volume-2a6ebc3a-d14a-44fb-95e3-fee69a31c250', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd10254-9457-404a-94e4-927af9baccdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd10254-9457-404a-94e4-927af9baccdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894fef1a-b812-4f9c-9227-0e8cc07142ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:11 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Volume 2a6ebc3a-d14a-44fb-95e3-fee69a31c250: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a6ebc3a-d14a-44fb-95e3-fee69a31c250', 'volume_size': 1} Jul 03 01:27:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:11 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1b6ba5d5-80ec-44df-9c6d-a2ac3618fa8b tempest-VolumeDependencyTests-554197803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.626s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:11 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-1b6ba5d5-80ec-44df-9c6d-a2ac3618fa8b tempest-VolumeDependencyTests-554197803 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:11 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1b6ba5d5-80ec-44df-9c6d-a2ac3618fa8b tempest-VolumeDependencyTests-554197803 None] Deleted volume successfully. Jul 03 01:27:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1b6ba5d5-80ec-44df-9c6d-a2ac3618fa8b tempest-VolumeDependencyTests-554197803 None] Lock "cinder-09e8941e-6646-4478-9635-9090e7337675-delete_volume" released by "delete_volume" :: held 4.428s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:12 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:12 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Flow 'volume_create_manager' (f281a652-f227-4f9a-ae7b-b66d977429f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d6a6c4-fc2d-4195-a6db-8584b0afdd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d23b94b-2df0-48a9-86dc-718b9fa15556 1073741824" returned: 0 in 1.419s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d6a6c4-fc2d-4195-a6db-8584b0afdd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1197118425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed95d59-9661-4ed9-a719-ec095f03fe17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeec64327648414485ea3961a11fcffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:12Z,use_quota=True,user_id='98f8221462e542caa1f9e0a370cf159a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:12 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9511fb2-e5d1-4d13-a638-64918644834e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9511fb2-e5d1-4d13-a638-64918644834e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b401026b-3afc-45f3-96f2-d4fc80712ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b401026b-3afc-45f3-96f2-d4fc80712ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed95d59-9661-4ed9-a719-ec095f03fe17', 'volume_name': 'volume-eed95d59-9661-4ed9-a719-ec095f03fe17', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3d36ef5-481f-4b06-ae79-3c45dcc6c3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3d36ef5-481f-4b06-ae79-3c45dcc6c3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7017ba3d-9a25-4329-a9a9-b1225fc6eafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:12 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Volume eed95d59-9661-4ed9-a719-ec095f03fe17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed95d59-9661-4ed9-a719-ec095f03fe17', 'volume_size': 1} Jul 03 01:27:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d361dc5-72c5-4240-ac80-84dcbea62f4a tempest-CinderUnicodeTest-1349231317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2.e3f9d735-9387-4ff8-b10b-74284f3b37da" returned: 0 in 1.680s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d361dc5-72c5-4240-ac80-84dcbea62f4a tempest-CinderUnicodeTest-1349231317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2.e3f9d735-9387-4ff8-b10b-74284f3b37da {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:12 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2.e3f9d735-9387-4ff8-b10b-74284f3b37da Jul 03 01:27:12 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d23b94b-2df0-48a9-86dc-718b9fa15556 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:12 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d23b94b-2df0-48a9-86dc-718b9fa15556 Jul 03 01:27:12 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:27:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:13 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:27:13 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Flow 'volume_create_manager' (4aee7246-bdad-496d-a0b2-62db7939b865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1aec04c-6a87-4465-9847-6828c18361ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1aec04c-6a87-4465-9847-6828c18361ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1169500584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69dd5be-896e-435f-b4ad-1ce9794c2ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeec64327648414485ea3961a11fcffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:13Z,use_quota=True,user_id='98f8221462e542caa1f9e0a370cf159a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f27edb9-e212-4902-8939-54f5bdff8004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f27edb9-e212-4902-8939-54f5bdff8004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a890bd09-c0e3-4352-b36b-9b2be597a089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a890bd09-c0e3-4352-b36b-9b2be597a089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b69dd5be-896e-435f-b4ad-1ce9794c2ee1', 'volume_name': 'volume-b69dd5be-896e-435f-b4ad-1ce9794c2ee1', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c0b2435-4d2b-4afc-8bca-408aefecc980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c0b2435-4d2b-4afc-8bca-408aefecc980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3dc80a6-1ce8-4db9-adcb-93fc95ead444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:13 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Volume b69dd5be-896e-435f-b4ad-1ce9794c2ee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b69dd5be-896e-435f-b4ad-1ce9794c2ee1', 'volume_size': 1} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:13 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d361dc5-72c5-4240-ac80-84dcbea62f4a tempest-CinderUnicodeTest-1349231317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2.e3f9d735-9387-4ff8-b10b-74284f3b37da" returned: 0 in 1.272s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:13 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d23b94b-2df0-48a9-86dc-718b9fa15556" returned: 0 in 1.231s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] <== create_volume: return (2815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.820s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.949s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-826881046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a6ebc3a-d14a-44fb-95e3-fee69a31c250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeec64327648414485ea3961a11fcffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:11Z,use_quota=True,user_id='98f8221462e542caa1f9e0a370cf159a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Creating volume 2a6ebc3a-d14a-44fb-95e3-fee69a31c250 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:13 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2a6ebc3a-d14a-44fb-95e3-fee69a31c250 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:13 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2a6ebc3a-d14a-44fb-95e3-fee69a31c250 1073741824 Jul 03 01:27:13 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ba222d-8bbc-4c10-8399-5230920b6f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d23b94b-2df0-48a9-86dc-718b9fa15556', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9895da1b-e5f4-4358-9ec1-d337c411fcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3d361dc5-72c5-4240-ac80-84dcbea62f4a tempest-CinderUnicodeTest-1349231317 None] Lock "cinder-quobyte-e3f9d735-9387-4ff8-b10b-74284f3b37da" released by "_delete_snapshot" :: held 5.874s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Flow 'volume_create_manager' (290818b8-1211-4541-b03c-340b428201b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a61d2bf6-cf80-4f41-8ad6-aec85fb20f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3d361dc5-72c5-4240-ac80-84dcbea62f4a tempest-CinderUnicodeTest-1349231317 None] Lock "cinder-quobyte-2e7434f8-e383-4373-9d5e-505b727c25f2" released by "delete_snapshot" :: held 5.982s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:13 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Volume volume-2d23b94b-2df0-48a9-86dc-718b9fa15556 (2d23b94b-2df0-48a9-86dc-718b9fa15556): created successfully Jul 03 01:27:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9895da1b-e5f4-4358-9ec1-d337c411fcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Flow 'volume_create_manager' (672f60e6-3f29-46d8-bb24-a1f9e6ccd3c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a61d2bf6-cf80-4f41-8ad6-aec85fb20f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1087632168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=989072cc-d027-48b0-ace6-67d58475130d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeec64327648414485ea3961a11fcffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:14Z,use_quota=True,user_id='98f8221462e542caa1f9e0a370cf159a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54de367e-1667-4372-a9d3-b166c0ba3a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54de367e-1667-4372-a9d3-b166c0ba3a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c66241c1-fc34-4a8d-968b-dfbebd900257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c66241c1-fc34-4a8d-968b-dfbebd900257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '989072cc-d027-48b0-ace6-67d58475130d', 'volume_name': 'volume-989072cc-d027-48b0-ace6-67d58475130d', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac00e49-39f4-4a75-adf4-d85b3c9772ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ac00e49-39f4-4a75-adf4-d85b3c9772ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ddf4a51-01fb-4049-a972-cffae37ca9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:14 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Volume 989072cc-d027-48b0-ace6-67d58475130d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-989072cc-d027-48b0-ace6-67d58475130d', 'volume_size': 1} Jul 03 01:27:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:14 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-5233ec11-2cae-4f1c-9cc8-d5a942920874 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Created volume successfully. Jul 03 01:27:14 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-3d361dc5-72c5-4240-ac80-84dcbea62f4a tempest-CinderUnicodeTest-1349231317 None] Created reservations ['14d7954f-7bbe-4e47-a448-ae8e4841650d', '51445d8f-ee6d-4c08-81f7-4fd0fc13ade5', '5b12bc79-4f1f-4afc-aa13-2e1caac68312', '7ee7c49c-bb78-47d3-b100-bf0957d5574a'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:14 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3d361dc5-72c5-4240-ac80-84dcbea62f4a tempest-CinderUnicodeTest-1349231317 None] Delete snapshot completed successfully. Jul 03 01:27:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3d361dc5-72c5-4240-ac80-84dcbea62f4a tempest-CinderUnicodeTest-1349231317 None] Lock "cinder-e3f9d735-9387-4ff8-b10b-74284f3b37da-delete_snapshot" released by "delete_snapshot" :: held 6.273s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:14 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b9236cc1-a7ea-4f98-8b44-057537cb0e90 tempest-CinderUnicodeTest-1349231317 None] Acquiring lock "cinder-2e7434f8-e383-4373-9d5e-505b727c25f2-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.542s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:14 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:14 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:27:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 29 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:27:14 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:27:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b9236cc1-a7ea-4f98-8b44-057537cb0e90 tempest-CinderUnicodeTest-1349231317 None] Lock "cinder-2e7434f8-e383-4373-9d5e-505b727c25f2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b9236cc1-a7ea-4f98-8b44-057537cb0e90 tempest-CinderUnicodeTest-1349231317 None] Acquiring lock "cinder-quobyte-2e7434f8-e383-4373-9d5e-505b727c25f2" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b9236cc1-a7ea-4f98-8b44-057537cb0e90 tempest-CinderUnicodeTest-1349231317 None] Lock "cinder-quobyte-2e7434f8-e383-4373-9d5e-505b727c25f2" acquired by "delete_volume" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:14 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb85957-3033-4ad2-9702-43f17fc24e2e]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b9236cc1-a7ea-4f98-8b44-057537cb0e90 tempest-CinderUnicodeTest-1349231317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:14 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2 Jul 03 01:27:14 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:15 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2a6ebc3a-d14a-44fb-95e3-fee69a31c250 1073741824" returned: 0 in 1.362s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2a6ebc3a-d14a-44fb-95e3-fee69a31c250 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:15 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2a6ebc3a-d14a-44fb-95e3-fee69a31c250 Jul 03 01:27:15 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:15 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b9236cc1-a7ea-4f98-8b44-057537cb0e90 tempest-CinderUnicodeTest-1349231317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2" returned: 0 in 1.200s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b9236cc1-a7ea-4f98-8b44-057537cb0e90 tempest-CinderUnicodeTest-1349231317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:15 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2 Jul 03 01:27:15 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:16 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2a6ebc3a-d14a-44fb-95e3-fee69a31c250" returned: 0 in 0.895s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] <== create_volume: return (2389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.393s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.716s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1197118425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed95d59-9661-4ed9-a719-ec095f03fe17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeec64327648414485ea3961a11fcffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:12Z,use_quota=True,user_id='98f8221462e542caa1f9e0a370cf159a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Creating volume eed95d59-9661-4ed9-a719-ec095f03fe17 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:16 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:27:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-eed95d59-9661-4ed9-a719-ec095f03fe17 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894fef1a-b812-4f9c-9227-0e8cc07142ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a6ebc3a-d14a-44fb-95e3-fee69a31c250', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c295e8ab-9e4a-4c88-a501-ed721eb7b4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:16 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-eed95d59-9661-4ed9-a719-ec095f03fe17 1073741824 Jul 03 01:27:16 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:16 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Volume volume-2a6ebc3a-d14a-44fb-95e3-fee69a31c250 (2a6ebc3a-d14a-44fb-95e3-fee69a31c250): created successfully Jul 03 01:27:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c295e8ab-9e4a-4c88-a501-ed721eb7b4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:16 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Flow 'volume_create_manager' (49304f25-48fd-49ae-a4a3-cde2f9bbb14b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:16 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3719321b-cba1-48ba-ad42-29caee9076c0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Created volume successfully. Jul 03 01:27:16 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b9236cc1-a7ea-4f98-8b44-057537cb0e90 tempest-CinderUnicodeTest-1349231317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2e7434f8-e383-4373-9d5e-505b727c25f2" returned: 0 in 0.766s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:16 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b9236cc1-a7ea-4f98-8b44-057537cb0e90 tempest-CinderUnicodeTest-1349231317 None] Lock "cinder-quobyte-2e7434f8-e383-4373-9d5e-505b727c25f2" released by "delete_volume" :: held 2.080s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:16 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-b9236cc1-a7ea-4f98-8b44-057537cb0e90 tempest-CinderUnicodeTest-1349231317 None] Created reservations ['29a5e787-c31e-4c22-99a5-1f44846a15f2', '424bd76e-fa02-43e3-b8d8-d4bcddaca636', '8628976a-9772-4a17-bd8d-c500bf421e38', 'aefc22a5-f802-4a82-b5ca-824804be7659'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b9236cc1-a7ea-4f98-8b44-057537cb0e90 tempest-CinderUnicodeTest-1349231317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b9236cc1-a7ea-4f98-8b44-057537cb0e90 tempest-CinderUnicodeTest-1349231317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b9236cc1-a7ea-4f98-8b44-057537cb0e90 tempest-CinderUnicodeTest-1349231317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:16 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b9236cc1-a7ea-4f98-8b44-057537cb0e90 tempest-CinderUnicodeTest-1349231317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b9236cc1-a7ea-4f98-8b44-057537cb0e90 tempest-CinderUnicodeTest-1349231317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b9236cc1-a7ea-4f98-8b44-057537cb0e90 tempest-CinderUnicodeTest-1349231317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:16 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:27:16 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:17 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-e5ee2cf4-5aa4-4b86-ba7d-c9c9824397b9 tempest-ProjectAdminTests-318567475 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86772) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 03 01:27:17 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-eed95d59-9661-4ed9-a719-ec095f03fe17 1073741824" returned: 0 in 1.059s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-eed95d59-9661-4ed9-a719-ec095f03fe17 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:17 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-eed95d59-9661-4ed9-a719-ec095f03fe17 Jul 03 01:27:17 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:17 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b9236cc1-a7ea-4f98-8b44-057537cb0e90 tempest-CinderUnicodeTest-1349231317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.755s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:17 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-b9236cc1-a7ea-4f98-8b44-057537cb0e90 tempest-CinderUnicodeTest-1349231317 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:17 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b9236cc1-a7ea-4f98-8b44-057537cb0e90 tempest-CinderUnicodeTest-1349231317 None] Deleted volume successfully. Jul 03 01:27:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b9236cc1-a7ea-4f98-8b44-057537cb0e90 tempest-CinderUnicodeTest-1349231317 None] Lock "cinder-2e7434f8-e383-4373-9d5e-505b727c25f2-delete_volume" released by "delete_volume" :: held 3.169s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-60dd91eb-623b-4942-9a75-5bf41d899ffa tempest-CinderUnicodeTest-1349231317 None] Acquiring lock "cinder-5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-60dd91eb-623b-4942-9a75-5bf41d899ffa tempest-CinderUnicodeTest-1349231317 None] Lock "cinder-5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-60dd91eb-623b-4942-9a75-5bf41d899ffa tempest-CinderUnicodeTest-1349231317 None] Acquiring lock "cinder-quobyte-5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-60dd91eb-623b-4942-9a75-5bf41d899ffa tempest-CinderUnicodeTest-1349231317 None] Lock "cinder-quobyte-5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5" acquired by "delete_volume" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:18 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ebbbec-651a-440b-aee9-4867e17f4cd8]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60dd91eb-623b-4942-9a75-5bf41d899ffa tempest-CinderUnicodeTest-1349231317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:18 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-eed95d59-9661-4ed9-a719-ec095f03fe17" returned: 0 in 0.883s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.995s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.644s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1169500584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69dd5be-896e-435f-b4ad-1ce9794c2ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeec64327648414485ea3961a11fcffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:13Z,use_quota=True,user_id='98f8221462e542caa1f9e0a370cf159a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Creating volume b69dd5be-896e-435f-b4ad-1ce9794c2ee1 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:18 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:27:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b69dd5be-896e-435f-b4ad-1ce9794c2ee1 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:18 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b69dd5be-896e-435f-b4ad-1ce9794c2ee1 1073741824 Jul 03 01:27:18 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7017ba3d-9a25-4329-a9a9-b1225fc6eafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed95d59-9661-4ed9-a719-ec095f03fe17', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc6a6a7-d818-405e-aa0e-958aa1cf8076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:18 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Volume volume-eed95d59-9661-4ed9-a719-ec095f03fe17 (eed95d59-9661-4ed9-a719-ec095f03fe17): created successfully Jul 03 01:27:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc6a6a7-d818-405e-aa0e-958aa1cf8076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Flow 'volume_create_manager' (f281a652-f227-4f9a-ae7b-b66d977429f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:18 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1a09423b-845f-4678-8825-4e3877f00504 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Created volume successfully. Jul 03 01:27:18 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5 Jul 03 01:27:18 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:19 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60dd91eb-623b-4942-9a75-5bf41d899ffa tempest-CinderUnicodeTest-1349231317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5" returned: 0 in 1.029s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60dd91eb-623b-4942-9a75-5bf41d899ffa tempest-CinderUnicodeTest-1349231317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:19 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5 Jul 03 01:27:19 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:19 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b69dd5be-896e-435f-b4ad-1ce9794c2ee1 1073741824" returned: 0 in 1.256s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b69dd5be-896e-435f-b4ad-1ce9794c2ee1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:19 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b69dd5be-896e-435f-b4ad-1ce9794c2ee1 Jul 03 01:27:19 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:19 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60dd91eb-623b-4942-9a75-5bf41d899ffa tempest-CinderUnicodeTest-1349231317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5" returned: 0 in 0.864s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-60dd91eb-623b-4942-9a75-5bf41d899ffa tempest-CinderUnicodeTest-1349231317 None] Lock "cinder-quobyte-5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5" released by "delete_volume" :: held 1.959s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:20 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-60dd91eb-623b-4942-9a75-5bf41d899ffa tempest-CinderUnicodeTest-1349231317 None] Created reservations ['06ba0113-861b-476d-a6d1-3397f936512b', '777fae47-03e0-4f39-b660-c89177064894', '7dc14635-8427-41f9-9fbc-1f327247ad94', '6d3e8e51-83db-4745-adab-7b61574fce42'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-60dd91eb-623b-4942-9a75-5bf41d899ffa tempest-CinderUnicodeTest-1349231317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-60dd91eb-623b-4942-9a75-5bf41d899ffa tempest-CinderUnicodeTest-1349231317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-60dd91eb-623b-4942-9a75-5bf41d899ffa tempest-CinderUnicodeTest-1349231317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-60dd91eb-623b-4942-9a75-5bf41d899ffa tempest-CinderUnicodeTest-1349231317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-60dd91eb-623b-4942-9a75-5bf41d899ffa tempest-CinderUnicodeTest-1349231317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60dd91eb-623b-4942-9a75-5bf41d899ffa tempest-CinderUnicodeTest-1349231317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:20 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:27:20 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:20 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b69dd5be-896e-435f-b4ad-1ce9794c2ee1" returned: 0 in 1.025s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] <== create_volume: return (2352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.356s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.413s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1087632168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=989072cc-d027-48b0-ace6-67d58475130d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeec64327648414485ea3961a11fcffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:14Z,use_quota=True,user_id='98f8221462e542caa1f9e0a370cf159a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Creating volume 989072cc-d027-48b0-ace6-67d58475130d {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:20 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:27:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-989072cc-d027-48b0-ace6-67d58475130d 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3dc80a6-1ce8-4db9-adcb-93fc95ead444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b69dd5be-896e-435f-b4ad-1ce9794c2ee1', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:20 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-989072cc-d027-48b0-ace6-67d58475130d 1073741824 Jul 03 01:27:20 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d33956df-16d0-43e4-a004-24278a2192de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:20 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Volume volume-b69dd5be-896e-435f-b4ad-1ce9794c2ee1 (b69dd5be-896e-435f-b4ad-1ce9794c2ee1): created successfully Jul 03 01:27:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d33956df-16d0-43e4-a004-24278a2192de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Flow 'volume_create_manager' (4aee7246-bdad-496d-a0b2-62db7939b865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:20 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f75f3a31-3a37-4058-a162-65bde3ac9f1a tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Created volume successfully. Jul 03 01:27:21 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-60dd91eb-623b-4942-9a75-5bf41d899ffa tempest-CinderUnicodeTest-1349231317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.062s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:21 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-60dd91eb-623b-4942-9a75-5bf41d899ffa tempest-CinderUnicodeTest-1349231317 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:21 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-60dd91eb-623b-4942-9a75-5bf41d899ffa tempest-CinderUnicodeTest-1349231317 None] Deleted volume successfully. Jul 03 01:27:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-60dd91eb-623b-4942-9a75-5bf41d899ffa tempest-CinderUnicodeTest-1349231317 None] Lock "cinder-5c3dd051-4d6d-49a3-a247-3cce0b8ca3b5-delete_volume" released by "delete_volume" :: held 3.358s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:22 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-989072cc-d027-48b0-ace6-67d58475130d 1073741824" returned: 0 in 1.583s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-989072cc-d027-48b0-ace6-67d58475130d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:22 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-989072cc-d027-48b0-ace6-67d58475130d Jul 03 01:27:22 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:23 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-989072cc-d027-48b0-ace6-67d58475130d" returned: 0 in 1.040s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:23 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] <== create_volume: return (2692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.700s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ddf4a51-01fb-4049-a972-cffae37ca9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-989072cc-d027-48b0-ace6-67d58475130d', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0ea010-1e2e-4c59-974c-74065e3bf922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:23 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Volume volume-989072cc-d027-48b0-ace6-67d58475130d (989072cc-d027-48b0-ace6-67d58475130d): created successfully Jul 03 01:27:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0ea010-1e2e-4c59-974c-74065e3bf922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:23 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Flow 'volume_create_manager' (290818b8-1211-4541-b03c-340b428201b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:23 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-35727c37-eb8f-40f7-a017-aa3ae5cbcec0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Created volume successfully. Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-10a81fa6-4716-491a-9f5f-8b37ccca861e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "cinder-989072cc-d027-48b0-ace6-67d58475130d-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-10a81fa6-4716-491a-9f5f-8b37ccca861e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "cinder-989072cc-d027-48b0-ace6-67d58475130d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-10a81fa6-4716-491a-9f5f-8b37ccca861e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "cinder-quobyte-989072cc-d027-48b0-ace6-67d58475130d" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-10a81fa6-4716-491a-9f5f-8b37ccca861e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "cinder-quobyte-989072cc-d027-48b0-ace6-67d58475130d" acquired by "delete_volume" :: waited 0.039s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Flow 'volume_create_manager' (d4dc8772-a8dd-4b74-81a1-76f838e46178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e6cb44-80c6-49b0-bbff-330203b8e413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a658fd1f-5c05-4c49-a5f0-4b22319b6135]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-10a81fa6-4716-491a-9f5f-8b37ccca861e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-989072cc-d027-48b0-ace6-67d58475130d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e6cb44-80c6-49b0-bbff-330203b8e413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-82711572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3db00ad-8dfe-4275-9cc1-846a1586ce66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970504d68ec94910bf67dae1490927d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:24Z,use_quota=True,user_id='bc9ce9ff10bf4b2cada6d0ec88b24ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590f3a71-a889-4f40-a7bd-dd5fa461602a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590f3a71-a889-4f40-a7bd-dd5fa461602a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35f44ac-8d3d-4044-bbf0-344045ebe4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35f44ac-8d3d-4044-bbf0-344045ebe4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3db00ad-8dfe-4275-9cc1-846a1586ce66', 'volume_name': 'volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f1cff6-217c-4d71-b3e2-7990b66d0b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f1cff6-217c-4d71-b3e2-7990b66d0b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a0a385-11e0-4606-8014-e340123b5673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:24 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Volume b3db00ad-8dfe-4275-9cc1-846a1586ce66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66', 'volume_size': 1} Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-82711572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3db00ad-8dfe-4275-9cc1-846a1586ce66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970504d68ec94910bf67dae1490927d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:24Z,use_quota=True,user_id='bc9ce9ff10bf4b2cada6d0ec88b24ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Creating volume b3db00ad-8dfe-4275-9cc1-846a1586ce66 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:24 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:27:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:24 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66 1073741824 Jul 03 01:27:24 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:24 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-989072cc-d027-48b0-ace6-67d58475130d Jul 03 01:27:24 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:25 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-10a81fa6-4716-491a-9f5f-8b37ccca861e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-989072cc-d027-48b0-ace6-67d58475130d" returned: 0 in 1.341s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-10a81fa6-4716-491a-9f5f-8b37ccca861e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-989072cc-d027-48b0-ace6-67d58475130d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:25 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-989072cc-d027-48b0-ace6-67d58475130d Jul 03 01:27:25 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:25 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66 1073741824" returned: 0 in 1.336s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:25 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66 Jul 03 01:27:25 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:26 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66" returned: 0 in 0.835s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] <== create_volume: return (2255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.259s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a0a385-11e0-4606-8014-e340123b5673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e09f32-e12f-48d7-a660-04165a04be0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:26 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Volume volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66 (b3db00ad-8dfe-4275-9cc1-846a1586ce66): created successfully Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e09f32-e12f-48d7-a660-04165a04be0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Flow 'volume_create_manager' (d4dc8772-a8dd-4b74-81a1-76f838e46178) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:26 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Flow 'volume_create_manager' (1fc29cbf-62b4-460c-85e3-da84076ccbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a388880e-66fb-430f-91ae-05aef863730f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-10a81fa6-4716-491a-9f5f-8b37ccca861e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-989072cc-d027-48b0-ace6-67d58475130d" returned: 0 in 1.135s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:26 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ef3a622c-c4a2-4884-9546-013bda1a700a tempest-ProjectMemberTests-1744160227 None] Created volume successfully. Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-10a81fa6-4716-491a-9f5f-8b37ccca861e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "cinder-quobyte-989072cc-d027-48b0-ace6-67d58475130d" released by "delete_volume" :: held 2.549s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a388880e-66fb-430f-91ae-05aef863730f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-873146741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e61f9f34-3bd3-4b76-8fd3-e0c40a663364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8828238dac7841569496db0e0bedd353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:27Z,use_quota=True,user_id='e94cf2fe7835400280046d098ea56eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b11c58d9-d3c3-4fdd-a276-d2461f7f2405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b11c58d9-d3c3-4fdd-a276-d2461f7f2405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4aff65a-fcf3-4c01-b3e5-6b9bf591ad6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4aff65a-fcf3-4c01-b3e5-6b9bf591ad6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e61f9f34-3bd3-4b76-8fd3-e0c40a663364', 'volume_name': 'volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a9e38f8-4095-49aa-93c3-a8f104bde0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a9e38f8-4095-49aa-93c3-a8f104bde0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc33c0b-945c-456c-abc2-e4950b875d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:26 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Volume e61f9f34-3bd3-4b76-8fd3-e0c40a663364: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364', 'volume_size': 1} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-873146741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e61f9f34-3bd3-4b76-8fd3-e0c40a663364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8828238dac7841569496db0e0bedd353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:27Z,use_quota=True,user_id='e94cf2fe7835400280046d098ea56eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Creating volume e61f9f34-3bd3-4b76-8fd3-e0c40a663364 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:26 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:26 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364 1073741824 Jul 03 01:27:26 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-10a81fa6-4716-491a-9f5f-8b37ccca861e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Created reservations ['4ed95e87-f030-4acc-9e82-18301953c67d', 'c73f5a6c-4ae0-4266-ad5e-0e12573389d9', 'cf6490d8-a0a9-4534-a42f-861199d8dadc', '011fa0c3-f455-4bd8-a649-982373d0f660'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-10a81fa6-4716-491a-9f5f-8b37ccca861e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-10a81fa6-4716-491a-9f5f-8b37ccca861e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-10a81fa6-4716-491a-9f5f-8b37ccca861e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-10a81fa6-4716-491a-9f5f-8b37ccca861e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-10a81fa6-4716-491a-9f5f-8b37ccca861e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-10a81fa6-4716-491a-9f5f-8b37ccca861e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:26 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:27:26 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f8b98c91-9dba-4240-b0e2-df586ab6ed5f tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "cinder-b69dd5be-896e-435f-b4ad-1ce9794c2ee1-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f8b98c91-9dba-4240-b0e2-df586ab6ed5f tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "cinder-b69dd5be-896e-435f-b4ad-1ce9794c2ee1-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f8b98c91-9dba-4240-b0e2-df586ab6ed5f tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "cinder-quobyte-b69dd5be-896e-435f-b4ad-1ce9794c2ee1" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:27 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f8b98c91-9dba-4240-b0e2-df586ab6ed5f tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "cinder-quobyte-b69dd5be-896e-435f-b4ad-1ce9794c2ee1" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:27 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16fe4e5-214c-4a75-8068-073924f4b16a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8b98c91-9dba-4240-b0e2-df586ab6ed5f tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b69dd5be-896e-435f-b4ad-1ce9794c2ee1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:27 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-10a81fa6-4716-491a-9f5f-8b37ccca861e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.037s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:27 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-10a81fa6-4716-491a-9f5f-8b37ccca861e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:27 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-10a81fa6-4716-491a-9f5f-8b37ccca861e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Deleted volume successfully. Jul 03 01:27:27 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b69dd5be-896e-435f-b4ad-1ce9794c2ee1 Jul 03 01:27:27 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-10a81fa6-4716-491a-9f5f-8b37ccca861e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "cinder-989072cc-d027-48b0-ace6-67d58475130d-delete_volume" released by "delete_volume" :: held 3.966s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a074a27e-151b-4a47-b661-5264d1619f18 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:28 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364 1073741824" returned: 0 in 1.490s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:28 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364 Jul 03 01:27:28 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:28 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8b98c91-9dba-4240-b0e2-df586ab6ed5f tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b69dd5be-896e-435f-b4ad-1ce9794c2ee1" returned: 0 in 1.041s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8b98c91-9dba-4240-b0e2-df586ab6ed5f tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b69dd5be-896e-435f-b4ad-1ce9794c2ee1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:28 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b69dd5be-896e-435f-b4ad-1ce9794c2ee1 Jul 03 01:27:28 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:29 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364" returned: 0 in 0.764s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] <== create_volume: return (2299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.303s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a074a27e-151b-4a47-b661-5264d1619f18 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.867s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Flow 'volume_create_manager' (7d0dc2af-63c8-4257-b123-6c912c2f9f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9558a38f-9ef7-40d2-a161-13a7227f0285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc33c0b-945c-456c-abc2-e4950b875d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f5223e-0786-41b1-8a55-c3b6b2621464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a074a27e-151b-4a47-b661-5264d1619f18 tempest-ProjectMemberTests-1744160227 None] Creating offline snapshot a898f5eb-85ae-440f-9253-ddef7f707646 of volume b3db00ad-8dfe-4275-9cc1-846a1586ce66 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9558a38f-9ef7-40d2-a161-13a7227f0285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1388505864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0a5b057-36a9-40ed-b06f-d7c72c561289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e657368659e54790bf99472693513f59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:29Z,use_quota=True,user_id='10a3f48b11c648b0893290359aca8e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84614f24-47f0-48ba-a980-cf1db40f5b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84614f24-47f0-48ba-a980-cf1db40f5b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676bd05c-22f8-477b-a555-49bf3e596206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676bd05c-22f8-477b-a555-49bf3e596206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0a5b057-36a9-40ed-b06f-d7c72c561289', 'volume_name': 'volume-f0a5b057-36a9-40ed-b06f-d7c72c561289', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362f26db-43a8-46d7-b86f-7bc334f7cd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362f26db-43a8-46d7-b86f-7bc334f7cd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d0f256-dae2-4227-a40a-89b4cc280eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:29 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Volume f0a5b057-36a9-40ed-b06f-d7c72c561289: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0a5b057-36a9-40ed-b06f-d7c72c561289', 'volume_size': 1} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27700b8-02ab-46fa-b678-a6f1146fafd8]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a074a27e-151b-4a47-b661-5264d1619f18 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:29 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Volume volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364 (e61f9f34-3bd3-4b76-8fd3-e0c40a663364): created successfully Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f5223e-0786-41b1-8a55-c3b6b2621464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Flow 'volume_create_manager' (1fc29cbf-62b4-460c-85e3-da84076ccbc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:29 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-96ae90e8-d0a4-40ff-857c-c0f85d229ac3 tempest-ProjectReaderTests-1434632810 None] Created volume successfully. Jul 03 01:27:29 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66 Jul 03 01:27:29 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:29 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8b98c91-9dba-4240-b0e2-df586ab6ed5f tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b69dd5be-896e-435f-b4ad-1ce9794c2ee1" returned: 0 in 0.725s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f8b98c91-9dba-4240-b0e2-df586ab6ed5f tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "cinder-quobyte-b69dd5be-896e-435f-b4ad-1ce9794c2ee1" released by "delete_volume" :: held 1.869s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-f8b98c91-9dba-4240-b0e2-df586ab6ed5f tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Created reservations ['fea8f662-ead4-461c-b022-3537d049ad70', 'efae765b-85b0-4215-bc71-3237b59d6530', '6e5067f6-5f18-4590-951f-d0526f878543', '64cd68c7-80ca-48e8-953b-10db67bf6654'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f8b98c91-9dba-4240-b0e2-df586ab6ed5f tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f8b98c91-9dba-4240-b0e2-df586ab6ed5f tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f8b98c91-9dba-4240-b0e2-df586ab6ed5f tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f8b98c91-9dba-4240-b0e2-df586ab6ed5f tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f8b98c91-9dba-4240-b0e2-df586ab6ed5f tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8b98c91-9dba-4240-b0e2-df586ab6ed5f tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:29 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:27:29 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ebe52ae4-ffa4-45a0-b95b-cadf71f3589e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "cinder-eed95d59-9661-4ed9-a719-ec095f03fe17-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ebe52ae4-ffa4-45a0-b95b-cadf71f3589e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "cinder-eed95d59-9661-4ed9-a719-ec095f03fe17-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b247d074-0ad0-47d9-99e7-f3c4f9b2392f tempest-ProjectReaderTests-1434632810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ebe52ae4-ffa4-45a0-b95b-cadf71f3589e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "cinder-quobyte-eed95d59-9661-4ed9-a719-ec095f03fe17" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ebe52ae4-ffa4-45a0-b95b-cadf71f3589e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "cinder-quobyte-eed95d59-9661-4ed9-a719-ec095f03fe17" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:30 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6814879-f876-4d4e-b1d8-4cbf85771101]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ebe52ae4-ffa4-45a0-b95b-cadf71f3589e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-eed95d59-9661-4ed9-a719-ec095f03fe17 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:30 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a074a27e-151b-4a47-b661-5264d1619f18 tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66" returned: 0 in 0.911s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a074a27e-151b-4a47-b661-5264d1619f18 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.a898f5eb-85ae-440f-9253-ddef7f707646 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:30 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-eed95d59-9661-4ed9-a719-ec095f03fe17 Jul 03 01:27:30 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:30 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.a898f5eb-85ae-440f-9253-ddef7f707646 1G Jul 03 01:27:30 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:30 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8b98c91-9dba-4240-b0e2-df586ab6ed5f tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.836s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:30 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-f8b98c91-9dba-4240-b0e2-df586ab6ed5f tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:30 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f8b98c91-9dba-4240-b0e2-df586ab6ed5f tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Deleted volume successfully. Jul 03 01:27:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-f8b98c91-9dba-4240-b0e2-df586ab6ed5f tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "cinder-b69dd5be-896e-435f-b4ad-1ce9794c2ee1-delete_volume" released by "delete_volume" :: held 2.990s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:30 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ebe52ae4-ffa4-45a0-b95b-cadf71f3589e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-eed95d59-9661-4ed9-a719-ec095f03fe17" returned: 0 in 0.859s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ebe52ae4-ffa4-45a0-b95b-cadf71f3589e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-eed95d59-9661-4ed9-a719-ec095f03fe17 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:30 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-eed95d59-9661-4ed9-a719-ec095f03fe17 Jul 03 01:27:30 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:30 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a074a27e-151b-4a47-b661-5264d1619f18 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.a898f5eb-85ae-440f-9253-ddef7f707646 1G" returned: 0 in 0.858s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a074a27e-151b-4a47-b661-5264d1619f18 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.a898f5eb-85ae-440f-9253-ddef7f707646 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:30 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.a898f5eb-85ae-440f-9253-ddef7f707646 Jul 03 01:27:30 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:31 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ebe52ae4-ffa4-45a0-b95b-cadf71f3589e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-eed95d59-9661-4ed9-a719-ec095f03fe17" returned: 0 in 0.695s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:31 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ebe52ae4-ffa4-45a0-b95b-cadf71f3589e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "cinder-quobyte-eed95d59-9661-4ed9-a719-ec095f03fe17" released by "delete_volume" :: held 1.601s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:31 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-ebe52ae4-ffa4-45a0-b95b-cadf71f3589e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Created reservations ['58fe831f-0619-4327-b567-4f24716f348b', '28476640-44d7-4e5c-b036-3ed5e3a94b7c', '2ef23a9d-ef5e-4f36-8171-f3d6007db9c4', '7ef9d7c3-a9f4-4143-bf18-a165c18e30fd'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:31 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ebe52ae4-ffa4-45a0-b95b-cadf71f3589e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ebe52ae4-ffa4-45a0-b95b-cadf71f3589e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ebe52ae4-ffa4-45a0-b95b-cadf71f3589e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:31 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ebe52ae4-ffa4-45a0-b95b-cadf71f3589e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ebe52ae4-ffa4-45a0-b95b-cadf71f3589e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ebe52ae4-ffa4-45a0-b95b-cadf71f3589e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a074a27e-151b-4a47-b661-5264d1619f18 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.a898f5eb-85ae-440f-9253-ddef7f707646" returned: 0 in 0.753s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:31 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-a074a27e-151b-4a47-b661-5264d1619f18 tempest-ProjectMemberTests-1744160227 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.a898f5eb-85ae-440f-9253-ddef7f707646 is being set with open permissions: ugo+rw Jul 03 01:27:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a074a27e-151b-4a47-b661-5264d1619f18 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.a898f5eb-85ae-440f-9253-ddef7f707646 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:31 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:27:31 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:31 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.a898f5eb-85ae-440f-9253-ddef7f707646 Jul 03 01:27:31 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-51b8d29b-1d46-44c5-aae7-7dce118b2e69 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "cinder-2a6ebc3a-d14a-44fb-95e3-fee69a31c250-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-51b8d29b-1d46-44c5-aae7-7dce118b2e69 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "cinder-2a6ebc3a-d14a-44fb-95e3-fee69a31c250-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-51b8d29b-1d46-44c5-aae7-7dce118b2e69 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "cinder-quobyte-2a6ebc3a-d14a-44fb-95e3-fee69a31c250" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-51b8d29b-1d46-44c5-aae7-7dce118b2e69 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "cinder-quobyte-2a6ebc3a-d14a-44fb-95e3-fee69a31c250" acquired by "delete_volume" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:32 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9312da43-94ea-4fcb-a748-8d6ffd823161]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-51b8d29b-1d46-44c5-aae7-7dce118b2e69 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2a6ebc3a-d14a-44fb-95e3-fee69a31c250 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:32 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2a6ebc3a-d14a-44fb-95e3-fee69a31c250 Jul 03 01:27:32 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:32 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ebe52ae4-ffa4-45a0-b95b-cadf71f3589e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.686s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:32 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-ebe52ae4-ffa4-45a0-b95b-cadf71f3589e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:32 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ebe52ae4-ffa4-45a0-b95b-cadf71f3589e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Deleted volume successfully. Jul 03 01:27:32 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a074a27e-151b-4a47-b661-5264d1619f18 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.a898f5eb-85ae-440f-9253-ddef7f707646" returned: 0 in 0.708s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ebe52ae4-ffa4-45a0-b95b-cadf71f3589e tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "cinder-eed95d59-9661-4ed9-a719-ec095f03fe17-delete_volume" released by "delete_volume" :: held 2.596s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a074a27e-151b-4a47-b661-5264d1619f18 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:32 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.info Jul 03 01:27:32 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:33 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-51b8d29b-1d46-44c5-aae7-7dce118b2e69 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2a6ebc3a-d14a-44fb-95e3-fee69a31c250" returned: 0 in 0.836s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-51b8d29b-1d46-44c5-aae7-7dce118b2e69 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2a6ebc3a-d14a-44fb-95e3-fee69a31c250 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:33 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2a6ebc3a-d14a-44fb-95e3-fee69a31c250 Jul 03 01:27:33 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:33 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a074a27e-151b-4a47-b661-5264d1619f18 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.info" returned: 0 in 0.665s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:33 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-a074a27e-151b-4a47-b661-5264d1619f18 tempest-ProjectMemberTests-1744160227 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.info is being set with open permissions: ugo+rw Jul 03 01:27:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a074a27e-151b-4a47-b661-5264d1619f18 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:33 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.info Jul 03 01:27:33 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:33 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-51b8d29b-1d46-44c5-aae7-7dce118b2e69 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2a6ebc3a-d14a-44fb-95e3-fee69a31c250" returned: 0 in 0.721s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-51b8d29b-1d46-44c5-aae7-7dce118b2e69 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "cinder-quobyte-2a6ebc3a-d14a-44fb-95e3-fee69a31c250" released by "delete_volume" :: held 1.608s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:33 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-51b8d29b-1d46-44c5-aae7-7dce118b2e69 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Created reservations ['5272d321-85cc-4560-bf2d-82bfe764d060', '8060e15d-cbf7-4be3-9c99-cf7bc5a192b3', '1830cb8f-73a5-4c2a-8846-8c8a018b8a6d', 'a330a926-fdd2-4732-8dd1-bcf62e6d7124'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:33 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a074a27e-151b-4a47-b661-5264d1619f18 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.info" returned: 0 in 0.732s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a074a27e-151b-4a47-b661-5264d1619f18 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.815s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.694s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1388505864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0a5b057-36a9-40ed-b06f-d7c72c561289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e657368659e54790bf99472693513f59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:29Z,use_quota=True,user_id='10a3f48b11c648b0893290359aca8e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Creating volume f0a5b057-36a9-40ed-b06f-d7c72c561289 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:33 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:27:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:33 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289 1073741824 Jul 03 01:27:33 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:33 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a074a27e-151b-4a47-b661-5264d1619f18 tempest-ProjectMemberTests-1744160227 None] Create snapshot completed successfully Jul 03 01:27:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-51b8d29b-1d46-44c5-aae7-7dce118b2e69 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-51b8d29b-1d46-44c5-aae7-7dce118b2e69 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-51b8d29b-1d46-44c5-aae7-7dce118b2e69 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-51b8d29b-1d46-44c5-aae7-7dce118b2e69 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-51b8d29b-1d46-44c5-aae7-7dce118b2e69 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-51b8d29b-1d46-44c5-aae7-7dce118b2e69 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:33 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:27:33 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-361256b4-db15-4cd7-a50f-8254b84d52b0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "cinder-2d23b94b-2df0-48a9-86dc-718b9fa15556-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-361256b4-db15-4cd7-a50f-8254b84d52b0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "cinder-2d23b94b-2df0-48a9-86dc-718b9fa15556-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2c49493f-e804-4bbb-bee5-27a17b8871fd tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-a898f5eb-85ae-440f-9253-ddef7f707646-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-361256b4-db15-4cd7-a50f-8254b84d52b0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "cinder-quobyte-2d23b94b-2df0-48a9-86dc-718b9fa15556" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2c49493f-e804-4bbb-bee5-27a17b8871fd tempest-ProjectMemberTests-1744160227 None] Lock "cinder-a898f5eb-85ae-440f-9253-ddef7f707646-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2c49493f-e804-4bbb-bee5-27a17b8871fd tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-b3db00ad-8dfe-4275-9cc1-846a1586ce66" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-361256b4-db15-4cd7-a50f-8254b84d52b0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "cinder-quobyte-2d23b94b-2df0-48a9-86dc-718b9fa15556" acquired by "delete_volume" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2c49493f-e804-4bbb-bee5-27a17b8871fd tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-b3db00ad-8dfe-4275-9cc1-846a1586ce66" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2c49493f-e804-4bbb-bee5-27a17b8871fd tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-a898f5eb-85ae-440f-9253-ddef7f707646" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:34 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ef6a09-1563-4597-8edb-fa0f7c1fc347]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-361256b4-db15-4cd7-a50f-8254b84d52b0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d23b94b-2df0-48a9-86dc-718b9fa15556 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2c49493f-e804-4bbb-bee5-27a17b8871fd tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-a898f5eb-85ae-440f-9253-ddef7f707646" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-2c49493f-e804-4bbb-bee5-27a17b8871fd tempest-ProjectMemberTests-1744160227 None] Deleting offline snapshot a898f5eb-85ae-440f-9253-ddef7f707646 of volume b3db00ad-8dfe-4275-9cc1-846a1586ce66 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:27:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-2c49493f-e804-4bbb-bee5-27a17b8871fd tempest-ProjectMemberTests-1744160227 None] snapshot_file for this snap is: volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.a898f5eb-85ae-440f-9253-ddef7f707646 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:27:34 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30eff8b-662c-48be-91b3-8bf2f1594a16]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2c49493f-e804-4bbb-bee5-27a17b8871fd tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.a898f5eb-85ae-440f-9253-ddef7f707646 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:34 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d23b94b-2df0-48a9-86dc-718b9fa15556 Jul 03 01:27:34 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:34 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-51b8d29b-1d46-44c5-aae7-7dce118b2e69 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.737s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:34 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-51b8d29b-1d46-44c5-aae7-7dce118b2e69 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:34 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-51b8d29b-1d46-44c5-aae7-7dce118b2e69 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Deleted volume successfully. Jul 03 01:27:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-51b8d29b-1d46-44c5-aae7-7dce118b2e69 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "cinder-2a6ebc3a-d14a-44fb-95e3-fee69a31c250-delete_volume" released by "delete_volume" :: held 2.648s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:34 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.a898f5eb-85ae-440f-9253-ddef7f707646 Jul 03 01:27:34 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:34 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289 1073741824" returned: 0 in 0.974s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:34 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289 Jul 03 01:27:34 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:35 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-361256b4-db15-4cd7-a50f-8254b84d52b0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d23b94b-2df0-48a9-86dc-718b9fa15556" returned: 0 in 0.823s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-361256b4-db15-4cd7-a50f-8254b84d52b0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d23b94b-2df0-48a9-86dc-718b9fa15556 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:35 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d23b94b-2df0-48a9-86dc-718b9fa15556 Jul 03 01:27:35 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:35 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2c49493f-e804-4bbb-bee5-27a17b8871fd tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.a898f5eb-85ae-440f-9253-ddef7f707646" returned: 0 in 0.920s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-2c49493f-e804-4bbb-bee5-27a17b8871fd tempest-ProjectMemberTests-1744160227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:27:35 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a695c341-e708-417d-aa14-8b7de5bda4e1]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2c49493f-e804-4bbb-bee5-27a17b8871fd tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:35 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289" returned: 0 in 0.702s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b247d074-0ad0-47d9-99e7-f3c4f9b2392f tempest-ProjectReaderTests-1434632810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.712s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d0f256-dae2-4227-a40a-89b4cc280eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0a5b057-36a9-40ed-b06f-d7c72c561289', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4e4ede-ed03-49bf-bbc5-44880c6f7eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-b247d074-0ad0-47d9-99e7-f3c4f9b2392f tempest-ProjectReaderTests-1434632810 None] Creating offline snapshot 748ef356-52f1-44eb-8ad8-60d171152fe1 of volume e61f9f34-3bd3-4b76-8fd3-e0c40a663364 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:27:35 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88afc96-5c26-4f5a-a2a1-ba67eb3a4971]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b247d074-0ad0-47d9-99e7-f3c4f9b2392f tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:35 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Volume volume-f0a5b057-36a9-40ed-b06f-d7c72c561289 (f0a5b057-36a9-40ed-b06f-d7c72c561289): created successfully Jul 03 01:27:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4e4ede-ed03-49bf-bbc5-44880c6f7eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:35 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66 Jul 03 01:27:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Flow 'volume_create_manager' (7d0dc2af-63c8-4257-b123-6c912c2f9f1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:35 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:35 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-087ab813-b24f-4f2d-81e6-8cfa95a41b46 tempest-SnapshotDependencyTests-607956472 None] Created volume successfully. Jul 03 01:27:35 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364 Jul 03 01:27:35 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:36 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-361256b4-db15-4cd7-a50f-8254b84d52b0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2d23b94b-2df0-48a9-86dc-718b9fa15556" returned: 0 in 0.720s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-361256b4-db15-4cd7-a50f-8254b84d52b0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "cinder-quobyte-2d23b94b-2df0-48a9-86dc-718b9fa15556" released by "delete_volume" :: held 1.597s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:36 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-361256b4-db15-4cd7-a50f-8254b84d52b0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Created reservations ['13e2147a-dddf-4281-8a52-552078250988', '9947cc06-47c6-4021-91f2-f5bc644685ca', 'f6ca0592-4fee-417c-bf76-365492c33ee0', '235c6b10-58c7-4841-9b2e-6f217195695a'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-361256b4-db15-4cd7-a50f-8254b84d52b0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-361256b4-db15-4cd7-a50f-8254b84d52b0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-361256b4-db15-4cd7-a50f-8254b84d52b0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:36 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-361256b4-db15-4cd7-a50f-8254b84d52b0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-361256b4-db15-4cd7-a50f-8254b84d52b0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-361256b4-db15-4cd7-a50f-8254b84d52b0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:36 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:27:36 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:36 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2c49493f-e804-4bbb-bee5-27a17b8871fd tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66" returned: 0 in 0.795s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2c49493f-e804-4bbb-bee5-27a17b8871fd tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.a898f5eb-85ae-440f-9253-ddef7f707646 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:36 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.a898f5eb-85ae-440f-9253-ddef7f707646 Jul 03 01:27:36 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:36 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b247d074-0ad0-47d9-99e7-f3c4f9b2392f tempest-ProjectReaderTests-1434632810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364" returned: 0 in 0.819s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b247d074-0ad0-47d9-99e7-f3c4f9b2392f tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.748ef356-52f1-44eb-8ad8-60d171152fe1 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:36 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.748ef356-52f1-44eb-8ad8-60d171152fe1 1G Jul 03 01:27:36 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3bef17f2-fc66-42af-bce7-3f63e3ddae40 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "cinder-87ab807c-560a-4bd4-a57c-f42cbf9e4548-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3bef17f2-fc66-42af-bce7-3f63e3ddae40 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "cinder-87ab807c-560a-4bd4-a57c-f42cbf9e4548-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3bef17f2-fc66-42af-bce7-3f63e3ddae40 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "cinder-quobyte-87ab807c-560a-4bd4-a57c-f42cbf9e4548" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3bef17f2-fc66-42af-bce7-3f63e3ddae40 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "cinder-quobyte-87ab807c-560a-4bd4-a57c-f42cbf9e4548" acquired by "delete_volume" :: waited 0.027s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:36 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2561da9d-ce3e-4cf4-bfc3-7bc9a862ce4f]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3bef17f2-fc66-42af-bce7-3f63e3ddae40 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-87ab807c-560a-4bd4-a57c-f42cbf9e4548 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:37 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-87ab807c-560a-4bd4-a57c-f42cbf9e4548 Jul 03 01:27:37 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:37 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-361256b4-db15-4cd7-a50f-8254b84d52b0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.807s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:37 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-361256b4-db15-4cd7-a50f-8254b84d52b0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-385d8ed4-8658-45d3-8e4b-18d9271ba01a tempest-SnapshotDependencyTests-607956472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:37 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-361256b4-db15-4cd7-a50f-8254b84d52b0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Deleted volume successfully. Jul 03 01:27:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-361256b4-db15-4cd7-a50f-8254b84d52b0 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "cinder-2d23b94b-2df0-48a9-86dc-718b9fa15556-delete_volume" released by "delete_volume" :: held 2.689s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:37 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2c49493f-e804-4bbb-bee5-27a17b8871fd tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.a898f5eb-85ae-440f-9253-ddef7f707646" returned: 0 in 1.007s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2c49493f-e804-4bbb-bee5-27a17b8871fd tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.a898f5eb-85ae-440f-9253-ddef7f707646 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:37 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.a898f5eb-85ae-440f-9253-ddef7f707646 Jul 03 01:27:37 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:37 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b247d074-0ad0-47d9-99e7-f3c4f9b2392f tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.748ef356-52f1-44eb-8ad8-60d171152fe1 1G" returned: 0 in 1.097s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b247d074-0ad0-47d9-99e7-f3c4f9b2392f tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.748ef356-52f1-44eb-8ad8-60d171152fe1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:37 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.748ef356-52f1-44eb-8ad8-60d171152fe1 Jul 03 01:27:37 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:37 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3bef17f2-fc66-42af-bce7-3f63e3ddae40 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-87ab807c-560a-4bd4-a57c-f42cbf9e4548" returned: 0 in 0.915s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3bef17f2-fc66-42af-bce7-3f63e3ddae40 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-87ab807c-560a-4bd4-a57c-f42cbf9e4548 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:37 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-87ab807c-560a-4bd4-a57c-f42cbf9e4548 Jul 03 01:27:37 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:38 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-2c49493f-e804-4bbb-bee5-27a17b8871fd tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66.a898f5eb-85ae-440f-9253-ddef7f707646" returned: 0 in 0.705s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2c49493f-e804-4bbb-bee5-27a17b8871fd tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-a898f5eb-85ae-440f-9253-ddef7f707646" released by "_delete_snapshot" :: held 3.562s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2c49493f-e804-4bbb-bee5-27a17b8871fd tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-b3db00ad-8dfe-4275-9cc1-846a1586ce66" released by "delete_snapshot" :: held 3.604s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:38 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-2c49493f-e804-4bbb-bee5-27a17b8871fd tempest-ProjectMemberTests-1744160227 None] Created reservations ['be7f989a-217c-4822-bcae-0e0e80bbddd4', 'a39602e5-471f-4a73-8fa4-f2858e691aad', 'c67aee5f-689b-45d7-bf8c-f387191594af', '9c38ac94-cf7a-4054-b16e-3539ea6784f3'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:38 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-2c49493f-e804-4bbb-bee5-27a17b8871fd tempest-ProjectMemberTests-1744160227 None] Delete snapshot completed successfully. Jul 03 01:27:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-2c49493f-e804-4bbb-bee5-27a17b8871fd tempest-ProjectMemberTests-1744160227 None] Lock "cinder-a898f5eb-85ae-440f-9253-ddef7f707646-delete_snapshot" released by "delete_snapshot" :: held 3.767s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:38 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b247d074-0ad0-47d9-99e7-f3c4f9b2392f tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.748ef356-52f1-44eb-8ad8-60d171152fe1" returned: 0 in 0.764s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:38 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-b247d074-0ad0-47d9-99e7-f3c4f9b2392f tempest-ProjectReaderTests-1434632810 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.748ef356-52f1-44eb-8ad8-60d171152fe1 is being set with open permissions: ugo+rw Jul 03 01:27:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b247d074-0ad0-47d9-99e7-f3c4f9b2392f tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.748ef356-52f1-44eb-8ad8-60d171152fe1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:38 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.748ef356-52f1-44eb-8ad8-60d171152fe1 Jul 03 01:27:38 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:38 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3bef17f2-fc66-42af-bce7-3f63e3ddae40 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-87ab807c-560a-4bd4-a57c-f42cbf9e4548" returned: 0 in 0.704s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3bef17f2-fc66-42af-bce7-3f63e3ddae40 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "cinder-quobyte-87ab807c-560a-4bd4-a57c-f42cbf9e4548" released by "delete_volume" :: held 1.695s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:38 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-3bef17f2-fc66-42af-bce7-3f63e3ddae40 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Created reservations ['59d39fe4-9327-4db9-9503-c67236fc7404', '2fadec61-5c1d-4395-8a67-f3c3a14ea0f5', '8bc935bc-7602-4842-a775-ddfb7d333475', '06151a9d-823e-4303-b538-fdaf899b2194'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3bef17f2-fc66-42af-bce7-3f63e3ddae40 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3bef17f2-fc66-42af-bce7-3f63e3ddae40 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3bef17f2-fc66-42af-bce7-3f63e3ddae40 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:38 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3bef17f2-fc66-42af-bce7-3f63e3ddae40 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3bef17f2-fc66-42af-bce7-3f63e3ddae40 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3bef17f2-fc66-42af-bce7-3f63e3ddae40 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:38 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:27:38 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-be9784a8-9865-4b77-9b2b-b4b14e342823 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-b3db00ad-8dfe-4275-9cc1-846a1586ce66-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-be9784a8-9865-4b77-9b2b-b4b14e342823 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-b3db00ad-8dfe-4275-9cc1-846a1586ce66-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-be9784a8-9865-4b77-9b2b-b4b14e342823 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-b3db00ad-8dfe-4275-9cc1-846a1586ce66" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:38 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-be9784a8-9865-4b77-9b2b-b4b14e342823 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-b3db00ad-8dfe-4275-9cc1-846a1586ce66" acquired by "delete_volume" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:38 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[311b0399-c039-4fa1-bcfb-1ed7374f7d51]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-be9784a8-9865-4b77-9b2b-b4b14e342823 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:39 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66 Jul 03 01:27:39 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:39 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b247d074-0ad0-47d9-99e7-f3c4f9b2392f tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.748ef356-52f1-44eb-8ad8-60d171152fe1" returned: 0 in 0.747s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b247d074-0ad0-47d9-99e7-f3c4f9b2392f tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:39 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.info Jul 03 01:27:39 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:39 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3bef17f2-fc66-42af-bce7-3f63e3ddae40 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.819s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:39 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-3bef17f2-fc66-42af-bce7-3f63e3ddae40 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:39 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3bef17f2-fc66-42af-bce7-3f63e3ddae40 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Deleted volume successfully. Jul 03 01:27:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3bef17f2-fc66-42af-bce7-3f63e3ddae40 tempest-CreateVolumesFromSourceVolumeTest-611781091 None] Lock "cinder-87ab807c-560a-4bd4-a57c-f42cbf9e4548-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:39 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-be9784a8-9865-4b77-9b2b-b4b14e342823 tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66" returned: 0 in 0.997s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-be9784a8-9865-4b77-9b2b-b4b14e342823 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:39 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b247d074-0ad0-47d9-99e7-f3c4f9b2392f tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.info" returned: 0 in 0.762s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:39 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-b247d074-0ad0-47d9-99e7-f3c4f9b2392f tempest-ProjectReaderTests-1434632810 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.info is being set with open permissions: ugo+rw Jul 03 01:27:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b247d074-0ad0-47d9-99e7-f3c4f9b2392f tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:39 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66 Jul 03 01:27:39 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:39 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.info Jul 03 01:27:39 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:40 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-be9784a8-9865-4b77-9b2b-b4b14e342823 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-b3db00ad-8dfe-4275-9cc1-846a1586ce66" returned: 0 in 0.790s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-be9784a8-9865-4b77-9b2b-b4b14e342823 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-b3db00ad-8dfe-4275-9cc1-846a1586ce66" released by "delete_volume" :: held 1.861s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:40 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b247d074-0ad0-47d9-99e7-f3c4f9b2392f tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.info" returned: 0 in 0.800s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b247d074-0ad0-47d9-99e7-f3c4f9b2392f tempest-ProjectReaderTests-1434632810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.129s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-385d8ed4-8658-45d3-8e4b-18d9271ba01a tempest-SnapshotDependencyTests-607956472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.696s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-385d8ed4-8658-45d3-8e4b-18d9271ba01a tempest-SnapshotDependencyTests-607956472 None] Creating offline snapshot dd754c14-f6c6-43e6-95c3-dbeed5e62284 of volume f0a5b057-36a9-40ed-b06f-d7c72c561289 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:27:40 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b247d074-0ad0-47d9-99e7-f3c4f9b2392f tempest-ProjectReaderTests-1434632810 None] Create snapshot completed successfully Jul 03 01:27:40 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3857a0dc-eb9c-40a8-a682-41ee7340ac2c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-385d8ed4-8658-45d3-8e4b-18d9271ba01a tempest-SnapshotDependencyTests-607956472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:40 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-be9784a8-9865-4b77-9b2b-b4b14e342823 tempest-ProjectMemberTests-1744160227 None] Created reservations ['56b4754f-0450-47ad-a739-cc027786fcd3', '4e7ce440-f6aa-4b71-bb35-019901c31676', 'f7e6c12a-dfea-4c85-b9c3-8adc76e511db', '12b4f0f3-5c06-456b-87e1-490bceafdf25'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-be9784a8-9865-4b77-9b2b-b4b14e342823 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-be9784a8-9865-4b77-9b2b-b4b14e342823 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-be9784a8-9865-4b77-9b2b-b4b14e342823 tempest-ProjectMemberTests-1744160227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-be9784a8-9865-4b77-9b2b-b4b14e342823 tempest-ProjectMemberTests-1744160227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-be9784a8-9865-4b77-9b2b-b4b14e342823 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-be9784a8-9865-4b77-9b2b-b4b14e342823 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:40 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289 Jul 03 01:27:40 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:40 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:27:40 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:41 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Flow 'volume_create_manager' (7a485698-6eef-4745-8f81-b59f3f8e88de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4edbc49-d1e6-4f19-954e-6d220f7f8982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4edbc49-d1e6-4f19-954e-6d220f7f8982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-5187511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1b8b0af-c237-4700-a0ef-ff2f24ae9e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970504d68ec94910bf67dae1490927d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:42Z,use_quota=True,user_id='bc9ce9ff10bf4b2cada6d0ec88b24ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77640c03-3b15-4e5d-b3f0-06ce2aadf35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77640c03-3b15-4e5d-b3f0-06ce2aadf35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a40e682-8437-46cb-92bd-3a2bcc0ec44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a40e682-8437-46cb-92bd-3a2bcc0ec44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1b8b0af-c237-4700-a0ef-ff2f24ae9e43', 'volume_name': 'volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b069c2ce-cc26-466b-bc5e-cc948d979b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b069c2ce-cc26-466b-bc5e-cc948d979b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d524b0d9-29a1-4610-a587-f7318976201f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:41 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Volume f1b8b0af-c237-4700-a0ef-ff2f24ae9e43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43', 'volume_size': 1} Jul 03 01:27:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a31c283f-de7a-4911-9044-c319eeb0614b tempest-ProjectReaderTests-1434632810 None] Acquiring lock "cinder-748ef356-52f1-44eb-8ad8-60d171152fe1-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a31c283f-de7a-4911-9044-c319eeb0614b tempest-ProjectReaderTests-1434632810 None] Lock "cinder-748ef356-52f1-44eb-8ad8-60d171152fe1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a31c283f-de7a-4911-9044-c319eeb0614b tempest-ProjectReaderTests-1434632810 None] Acquiring lock "cinder-quobyte-e61f9f34-3bd3-4b76-8fd3-e0c40a663364" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a31c283f-de7a-4911-9044-c319eeb0614b tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-e61f9f34-3bd3-4b76-8fd3-e0c40a663364" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a31c283f-de7a-4911-9044-c319eeb0614b tempest-ProjectReaderTests-1434632810 None] Acquiring lock "cinder-quobyte-748ef356-52f1-44eb-8ad8-60d171152fe1" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a31c283f-de7a-4911-9044-c319eeb0614b tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-748ef356-52f1-44eb-8ad8-60d171152fe1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a31c283f-de7a-4911-9044-c319eeb0614b tempest-ProjectReaderTests-1434632810 None] Deleting offline snapshot 748ef356-52f1-44eb-8ad8-60d171152fe1 of volume e61f9f34-3bd3-4b76-8fd3-e0c40a663364 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:27:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a31c283f-de7a-4911-9044-c319eeb0614b tempest-ProjectReaderTests-1434632810 None] snapshot_file for this snap is: volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.748ef356-52f1-44eb-8ad8-60d171152fe1 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:27:41 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a926c2-2fab-4d58-ae67-c13fe5f47341]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a31c283f-de7a-4911-9044-c319eeb0614b tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.748ef356-52f1-44eb-8ad8-60d171152fe1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:41 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-be9784a8-9865-4b77-9b2b-b4b14e342823 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.004s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:41 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-be9784a8-9865-4b77-9b2b-b4b14e342823 tempest-ProjectMemberTests-1744160227 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:41 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-be9784a8-9865-4b77-9b2b-b4b14e342823 tempest-ProjectMemberTests-1744160227 None] Deleted volume successfully. Jul 03 01:27:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-be9784a8-9865-4b77-9b2b-b4b14e342823 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-b3db00ad-8dfe-4275-9cc1-846a1586ce66-delete_volume" released by "delete_volume" :: held 3.199s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:41 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-385d8ed4-8658-45d3-8e4b-18d9271ba01a tempest-SnapshotDependencyTests-607956472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289" returned: 0 in 1.210s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-385d8ed4-8658-45d3-8e4b-18d9271ba01a tempest-SnapshotDependencyTests-607956472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.dd754c14-f6c6-43e6-95c3-dbeed5e62284 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:42 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.748ef356-52f1-44eb-8ad8-60d171152fe1 Jul 03 01:27:42 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:42 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.dd754c14-f6c6-43e6-95c3-dbeed5e62284 1G Jul 03 01:27:42 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:42 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a31c283f-de7a-4911-9044-c319eeb0614b tempest-ProjectReaderTests-1434632810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.748ef356-52f1-44eb-8ad8-60d171152fe1" returned: 0 in 0.884s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a31c283f-de7a-4911-9044-c319eeb0614b tempest-ProjectReaderTests-1434632810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:27:42 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a21376a-84b7-4761-b26d-b78bba9ffe50]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a31c283f-de7a-4911-9044-c319eeb0614b tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:42 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-385d8ed4-8658-45d3-8e4b-18d9271ba01a tempest-SnapshotDependencyTests-607956472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.dd754c14-f6c6-43e6-95c3-dbeed5e62284 1G" returned: 0 in 0.869s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-385d8ed4-8658-45d3-8e4b-18d9271ba01a tempest-SnapshotDependencyTests-607956472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0a5b057-36a9-40ed-b06f-d7c72c561289 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.dd754c14-f6c6-43e6-95c3-dbeed5e62284 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:42 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0a5b057-36a9-40ed-b06f-d7c72c561289 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.dd754c14-f6c6-43e6-95c3-dbeed5e62284 Jul 03 01:27:42 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:42 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364 Jul 03 01:27:42 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:43 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-385d8ed4-8658-45d3-8e4b-18d9271ba01a tempest-SnapshotDependencyTests-607956472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0a5b057-36a9-40ed-b06f-d7c72c561289 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.dd754c14-f6c6-43e6-95c3-dbeed5e62284" returned: 0 in 0.705s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:43 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-385d8ed4-8658-45d3-8e4b-18d9271ba01a tempest-SnapshotDependencyTests-607956472 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.dd754c14-f6c6-43e6-95c3-dbeed5e62284 is being set with open permissions: ugo+rw Jul 03 01:27:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-385d8ed4-8658-45d3-8e4b-18d9271ba01a tempest-SnapshotDependencyTests-607956472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.dd754c14-f6c6-43e6-95c3-dbeed5e62284 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:43 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.dd754c14-f6c6-43e6-95c3-dbeed5e62284 Jul 03 01:27:43 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:43 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a31c283f-de7a-4911-9044-c319eeb0614b tempest-ProjectReaderTests-1434632810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364" returned: 0 in 0.821s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a31c283f-de7a-4911-9044-c319eeb0614b tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.748ef356-52f1-44eb-8ad8-60d171152fe1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:43 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.748ef356-52f1-44eb-8ad8-60d171152fe1 Jul 03 01:27:43 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:44 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-385d8ed4-8658-45d3-8e4b-18d9271ba01a tempest-SnapshotDependencyTests-607956472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.dd754c14-f6c6-43e6-95c3-dbeed5e62284" returned: 0 in 0.682s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-385d8ed4-8658-45d3-8e4b-18d9271ba01a tempest-SnapshotDependencyTests-607956472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:44 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.info Jul 03 01:27:44 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:44 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a31c283f-de7a-4911-9044-c319eeb0614b tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.748ef356-52f1-44eb-8ad8-60d171152fe1" returned: 0 in 0.845s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a31c283f-de7a-4911-9044-c319eeb0614b tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.748ef356-52f1-44eb-8ad8-60d171152fe1 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:44 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.748ef356-52f1-44eb-8ad8-60d171152fe1 Jul 03 01:27:44 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:45 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-385d8ed4-8658-45d3-8e4b-18d9271ba01a tempest-SnapshotDependencyTests-607956472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.info" returned: 0 in 0.739s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:45 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-385d8ed4-8658-45d3-8e4b-18d9271ba01a tempest-SnapshotDependencyTests-607956472 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.info is being set with open permissions: ugo+rw Jul 03 01:27:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-385d8ed4-8658-45d3-8e4b-18d9271ba01a tempest-SnapshotDependencyTests-607956472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:45 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.info Jul 03 01:27:45 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:45 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a31c283f-de7a-4911-9044-c319eeb0614b tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364.748ef356-52f1-44eb-8ad8-60d171152fe1" returned: 0 in 0.773s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a31c283f-de7a-4911-9044-c319eeb0614b tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-748ef356-52f1-44eb-8ad8-60d171152fe1" released by "_delete_snapshot" :: held 3.473s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a31c283f-de7a-4911-9044-c319eeb0614b tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-e61f9f34-3bd3-4b76-8fd3-e0c40a663364" released by "delete_snapshot" :: held 3.503s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:45 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-a31c283f-de7a-4911-9044-c319eeb0614b tempest-ProjectReaderTests-1434632810 None] Created reservations ['7d818b5b-a8e2-4d30-8d9f-05ccef122610', '49853efe-ef27-427b-beeb-db9dea4750d1', 'a45b2174-ad86-4089-9058-96e32f9eb7a5', '8eb59f50-443f-4a53-b12d-bdf93c98f07b'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:45 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a31c283f-de7a-4911-9044-c319eeb0614b tempest-ProjectReaderTests-1434632810 None] Delete snapshot completed successfully. Jul 03 01:27:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a31c283f-de7a-4911-9044-c319eeb0614b tempest-ProjectReaderTests-1434632810 None] Lock "cinder-748ef356-52f1-44eb-8ad8-60d171152fe1-delete_snapshot" released by "delete_snapshot" :: held 3.662s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:45 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-385d8ed4-8658-45d3-8e4b-18d9271ba01a tempest-SnapshotDependencyTests-607956472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.info" returned: 0 in 0.758s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-385d8ed4-8658-45d3-8e4b-18d9271ba01a tempest-SnapshotDependencyTests-607956472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.082s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.085s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-5187511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1b8b0af-c237-4700-a0ef-ff2f24ae9e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970504d68ec94910bf67dae1490927d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:42Z,use_quota=True,user_id='bc9ce9ff10bf4b2cada6d0ec88b24ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:27:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Creating volume f1b8b0af-c237-4700-a0ef-ff2f24ae9e43 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:27:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:45 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:45 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:27:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:45 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43 1073741824 Jul 03 01:27:45 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:45 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-385d8ed4-8658-45d3-8e4b-18d9271ba01a tempest-SnapshotDependencyTests-607956472 None] Create snapshot completed successfully Jul 03 01:27:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-166a90b8-cb50-4757-b9f9-cc69e278f4a8 tempest-ProjectReaderTests-1434632810 None] Acquiring lock "cinder-e61f9f34-3bd3-4b76-8fd3-e0c40a663364-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-166a90b8-cb50-4757-b9f9-cc69e278f4a8 tempest-ProjectReaderTests-1434632810 None] Lock "cinder-e61f9f34-3bd3-4b76-8fd3-e0c40a663364-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-166a90b8-cb50-4757-b9f9-cc69e278f4a8 tempest-ProjectReaderTests-1434632810 None] Acquiring lock "cinder-quobyte-e61f9f34-3bd3-4b76-8fd3-e0c40a663364" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-166a90b8-cb50-4757-b9f9-cc69e278f4a8 tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-e61f9f34-3bd3-4b76-8fd3-e0c40a663364" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:46 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0a3c15-e6fd-414f-9c64-aa7c209dcc84]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-166a90b8-cb50-4757-b9f9-cc69e278f4a8 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:46 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364 Jul 03 01:27:46 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:46 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43 1073741824" returned: 0 in 1.086s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:47 devstack sudo[108030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43 Jul 03 01:27:47 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:47 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-166a90b8-cb50-4757-b9f9-cc69e278f4a8 tempest-ProjectReaderTests-1434632810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364" returned: 0 in 1.120s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-166a90b8-cb50-4757-b9f9-cc69e278f4a8 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:47 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364 Jul 03 01:27:47 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Flow 'volume_create_manager' (6b3b9a45-6673-4b31-809a-54cebe7f9954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17059169-ae88-4ad1-b885-3d817b635f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17059169-ae88-4ad1-b885-3d817b635f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddda9a27-b921-44c7-b03c-293ea9bd70a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e657368659e54790bf99472693513f59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dd754c14-f6c6-43e6-95c3-dbeed5e62284,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:47Z,use_quota=True,user_id='10a3f48b11c648b0893290359aca8e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aecf98e2-fc99-48b3-b034-eed2ab8b20be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aecf98e2-fc99-48b3-b034-eed2ab8b20be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a1e457-8176-4873-b006-9eaafa04a3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a1e457-8176-4873-b006-9eaafa04a3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ddda9a27-b921-44c7-b03c-293ea9bd70a5', 'volume_name': 'volume-ddda9a27-b921-44c7-b03c-293ea9bd70a5', 'volume_size': 1, 'snapshot_id': 'dd754c14-f6c6-43e6-95c3-dbeed5e62284'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d50f16-f764-425b-b5d1-711dd351e00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d50f16-f764-425b-b5d1-711dd351e00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b12b22-8d3c-4f7c-9a56-9127b283b568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:47 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Volume ddda9a27-b921-44c7-b03c-293ea9bd70a5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ddda9a27-b921-44c7-b03c-293ea9bd70a5', 'volume_size': 1, 'snapshot_id': 'dd754c14-f6c6-43e6-95c3-dbeed5e62284'} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:47 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43" returned: 0 in 0.750s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.334s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Acquiring lock "cinder-quobyte-dd754c14-f6c6-43e6-95c3-dbeed5e62284-ddda9a27-b921-44c7-b03c-293ea9bd70a5" by "_create_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d524b0d9-29a1-4610-a587-f7318976201f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f8277a-e0c5-442b-9863-6208876fbbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Lock "cinder-quobyte-dd754c14-f6c6-43e6-95c3-dbeed5e62284-ddda9a27-b921-44c7-b03c-293ea9bd70a5" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Creating volume ddda9a27-b921-44c7-b03c-293ea9bd70a5 from snapshot dd754c14-f6c6-43e6-95c3-dbeed5e62284 {{(pid=86772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Acquiring lock "cinder-quobyte-ddda9a27-b921-44c7-b03c-293ea9bd70a5" by "_copy_volume_from_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:47 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Volume volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43 (f1b8b0af-c237-4700-a0ef-ff2f24ae9e43): created successfully Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f8277a-e0c5-442b-9863-6208876fbbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Flow 'volume_create_manager' (7a485698-6eef-4745-8f81-b59f3f8e88de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Lock "cinder-quobyte-ddda9a27-b921-44c7-b03c-293ea9bd70a5" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] snapshot: dd754c14-f6c6-43e6-95c3-dbeed5e62284, volume: ddda9a27-b921-44c7-b03c-293ea9bd70a5, {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 03 01:27:47 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-fa969d52-b4e3-4789-925d-d3b260bff1f6 tempest-ProjectMemberTests-1744160227 None] Created volume successfully. Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa67ba2f-9f7f-4db5-91af-433049f3d4b5]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.dd754c14-f6c6-43e6-95c3-dbeed5e62284 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:48 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.dd754c14-f6c6-43e6-95c3-dbeed5e62284 Jul 03 01:27:48 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:48 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-166a90b8-cb50-4757-b9f9-cc69e278f4a8 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e61f9f34-3bd3-4b76-8fd3-e0c40a663364" returned: 0 in 0.770s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-166a90b8-cb50-4757-b9f9-cc69e278f4a8 tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-e61f9f34-3bd3-4b76-8fd3-e0c40a663364" released by "delete_volume" :: held 1.972s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:48 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-166a90b8-cb50-4757-b9f9-cc69e278f4a8 tempest-ProjectReaderTests-1434632810 None] Created reservations ['de469024-f80a-43a2-8e4f-330cc5884ef5', '2c3fd9ea-74d6-4a0e-bcda-c42907b5d2ae', '569116ed-aec6-4602-a4fb-16f3cd048be9', 'ff7e8d9f-6d0c-4eed-bc9a-851c08043511'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:27:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cbdb0a2e-a0cc-4f1b-b3bb-c6f28db35a21 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-166a90b8-cb50-4757-b9f9-cc69e278f4a8 tempest-ProjectReaderTests-1434632810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-166a90b8-cb50-4757-b9f9-cc69e278f4a8 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-166a90b8-cb50-4757-b9f9-cc69e278f4a8 tempest-ProjectReaderTests-1434632810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:27:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-166a90b8-cb50-4757-b9f9-cc69e278f4a8 tempest-ProjectReaderTests-1434632810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:27:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-166a90b8-cb50-4757-b9f9-cc69e278f4a8 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-166a90b8-cb50-4757-b9f9-cc69e278f4a8 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:48 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:27:48 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:48 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.dd754c14-f6c6-43e6-95c3-dbeed5e62284" returned: 0 in 0.926s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0a5b057-36a9-40ed-b06f-d7c72c561289(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:27:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289 {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 03 01:27:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Creating direct copy from snapshot {{(pid=86772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 03 01:27:48 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c819be-c832-44c1-b2c5-0d14fe822cfd]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:48 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289 Jul 03 01:27:48 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:48 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-166a90b8-cb50-4757-b9f9-cc69e278f4a8 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.703s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:48 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-166a90b8-cb50-4757-b9f9-cc69e278f4a8 tempest-ProjectReaderTests-1434632810 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:27:48 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-166a90b8-cb50-4757-b9f9-cc69e278f4a8 tempest-ProjectReaderTests-1434632810 None] Deleted volume successfully. Jul 03 01:27:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-166a90b8-cb50-4757-b9f9-cc69e278f4a8 tempest-ProjectReaderTests-1434632810 None] Lock "cinder-e61f9f34-3bd3-4b76-8fd3-e0c40a663364-delete_volume" released by "delete_volume" :: held 3.004s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:49 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289" returned: 0 in 0.837s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:49 devstack cinder-volume[86772]: DEBUG cinder.utils [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Path /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ddda9a27-b921-44c7-b03c-293ea9bd70a5 not found in is_blk_device check {{(pid=86772) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 03 01:27:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ddda9a27-b921-44c7-b03c-293ea9bd70a5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:49 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ddda9a27-b921-44c7-b03c-293ea9bd70a5 Jul 03 01:27:49 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:49 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:27:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Flow 'volume_create_manager' (528f79f4-dd51-498c-b20a-63187725bf1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a81b24e-18ee-43e0-8c5f-fced1b1e6a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a81b24e-18ee-43e0-8c5f-fced1b1e6a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-640272213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64769c72-520a-46d8-a295-86c776cd8982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8828238dac7841569496db0e0bedd353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:50Z,use_quota=True,user_id='e94cf2fe7835400280046d098ea56eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f40ce4-f7ab-4280-ae21-e14b20d23e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f40ce4-f7ab-4280-ae21-e14b20d23e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4658f9b5-b39f-492c-8368-d09ab1b1efbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4658f9b5-b39f-492c-8368-d09ab1b1efbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64769c72-520a-46d8-a295-86c776cd8982', 'volume_name': 'volume-64769c72-520a-46d8-a295-86c776cd8982', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c14acb-6fd7-46ed-a73d-e53ad69493a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c14acb-6fd7-46ed-a73d-e53ad69493a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a790349-44bb-4204-9a0f-a279e317a626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:49 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Volume 64769c72-520a-46d8-a295-86c776cd8982: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64769c72-520a-46d8-a295-86c776cd8982', 'volume_size': 1} Jul 03 01:27:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:27:55 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ddda9a27-b921-44c7-b03c-293ea9bd70a5" returned: 0 in 5.434s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:55 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3719f676-e49d-497d-809a-4c6589c5b7c0]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:55 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289 Jul 03 01:27:55 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:56 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289" returned: 0 in 0.972s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:56 devstack cinder-volume[86772]: DEBUG cinder.image.image_utils [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Image conversion details: src /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289, size 1024.00 MB, duration 5.43 sec, destination /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ddda9a27-b921-44c7-b03c-293ea9bd70a5 {{(pid=86772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 03 01:27:56 devstack cinder-volume[86772]: INFO cinder.image.image_utils [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Converted 1024.00 MB image at 188.42 MB/s Jul 03 01:27:56 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ddda9a27-b921-44c7-b03c-293ea9bd70a5 is being set with open permissions: ugo+rw Jul 03 01:27:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ddda9a27-b921-44c7-b03c-293ea9bd70a5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:56 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ddda9a27-b921-44c7-b03c-293ea9bd70a5 Jul 03 01:27:56 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:56 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ddda9a27-b921-44c7-b03c-293ea9bd70a5" returned: 0 in 0.648s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Lock "cinder-quobyte-ddda9a27-b921-44c7-b03c-293ea9bd70a5" released by "_copy_volume_from_snapshot" :: held 8.934s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:56 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Lock "cinder-quobyte-dd754c14-f6c6-43e6-95c3-dbeed5e62284-ddda9a27-b921-44c7-b03c-293ea9bd70a5" released by "_create_volume_from_snapshot" :: held 8.997s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:27:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.033s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:27:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cbdb0a2e-a0cc-4f1b-b3bb-c6f28db35a21 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.541s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:27:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-cbdb0a2e-a0cc-4f1b-b3bb-c6f28db35a21 tempest-ProjectMemberTests-1744160227 None] Creating offline snapshot 48d1dbde-4421-4440-a766-7e73ffacd6d2 of volume f1b8b0af-c237-4700-a0ef-ff2f24ae9e43 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:27:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b12b22-8d3c-4f7c-9a56-9127b283b568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddda9a27-b921-44c7-b03c-293ea9bd70a5', 'volume_size': 1, 'snapshot_id': 'dd754c14-f6c6-43e6-95c3-dbeed5e62284'}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d61818-cbef-4a03-abda-d93b2878adc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:27:56 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d38770-b977-4777-af66-36c5c845f738]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cbdb0a2e-a0cc-4f1b-b3bb-c6f28db35a21 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:56 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Volume volume-ddda9a27-b921-44c7-b03c-293ea9bd70a5 (ddda9a27-b921-44c7-b03c-293ea9bd70a5): created successfully Jul 03 01:27:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d61818-cbef-4a03-abda-d93b2878adc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:27:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Flow 'volume_create_manager' (6b3b9a45-6673-4b31-809a-54cebe7f9954) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:27:56 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-cbdf4783-077f-4d31-9fb3-b4037a54d8d9 tempest-SnapshotDependencyTests-607956472 None] Created volume successfully. Jul 03 01:27:56 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43 Jul 03 01:27:56 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4563e184-e4ca-47c1-bbfa-9a78781c09ec tempest-SnapshotDependencyTests-607956472 None] Acquiring lock "cinder-dd754c14-f6c6-43e6-95c3-dbeed5e62284-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4563e184-e4ca-47c1-bbfa-9a78781c09ec tempest-SnapshotDependencyTests-607956472 None] Lock "cinder-dd754c14-f6c6-43e6-95c3-dbeed5e62284-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4563e184-e4ca-47c1-bbfa-9a78781c09ec tempest-SnapshotDependencyTests-607956472 None] Acquiring lock "cinder-quobyte-f0a5b057-36a9-40ed-b06f-d7c72c561289" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4563e184-e4ca-47c1-bbfa-9a78781c09ec tempest-SnapshotDependencyTests-607956472 None] Lock "cinder-quobyte-f0a5b057-36a9-40ed-b06f-d7c72c561289" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4563e184-e4ca-47c1-bbfa-9a78781c09ec tempest-SnapshotDependencyTests-607956472 None] Acquiring lock "cinder-quobyte-dd754c14-f6c6-43e6-95c3-dbeed5e62284" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:27:57 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4563e184-e4ca-47c1-bbfa-9a78781c09ec tempest-SnapshotDependencyTests-607956472 None] Lock "cinder-quobyte-dd754c14-f6c6-43e6-95c3-dbeed5e62284" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:27:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4563e184-e4ca-47c1-bbfa-9a78781c09ec tempest-SnapshotDependencyTests-607956472 None] Deleting offline snapshot dd754c14-f6c6-43e6-95c3-dbeed5e62284 of volume f0a5b057-36a9-40ed-b06f-d7c72c561289 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:27:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4563e184-e4ca-47c1-bbfa-9a78781c09ec tempest-SnapshotDependencyTests-607956472 None] snapshot_file for this snap is: volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.dd754c14-f6c6-43e6-95c3-dbeed5e62284 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:27:57 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[071087db-fd7f-40ea-ae88-34c408cbbbf5]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4563e184-e4ca-47c1-bbfa-9a78781c09ec tempest-SnapshotDependencyTests-607956472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.dd754c14-f6c6-43e6-95c3-dbeed5e62284 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:57 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.dd754c14-f6c6-43e6-95c3-dbeed5e62284 Jul 03 01:27:57 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:57 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cbdb0a2e-a0cc-4f1b-b3bb-c6f28db35a21 tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43" returned: 0 in 0.813s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cbdb0a2e-a0cc-4f1b-b3bb-c6f28db35a21 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.48d1dbde-4421-4440-a766-7e73ffacd6d2 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:57 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.48d1dbde-4421-4440-a766-7e73ffacd6d2 1G Jul 03 01:27:57 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:58 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4563e184-e4ca-47c1-bbfa-9a78781c09ec tempest-SnapshotDependencyTests-607956472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.dd754c14-f6c6-43e6-95c3-dbeed5e62284" returned: 0 in 0.893s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:58 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4563e184-e4ca-47c1-bbfa-9a78781c09ec tempest-SnapshotDependencyTests-607956472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0a5b057-36a9-40ed-b06f-d7c72c561289(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:27:58 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbac57f6-d376-4d50-bab6-72c624ced139]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:27:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4563e184-e4ca-47c1-bbfa-9a78781c09ec tempest-SnapshotDependencyTests-607956472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:58 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289 Jul 03 01:27:58 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:58 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cbdb0a2e-a0cc-4f1b-b3bb-c6f28db35a21 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.48d1dbde-4421-4440-a766-7e73ffacd6d2 1G" returned: 0 in 0.898s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cbdb0a2e-a0cc-4f1b-b3bb-c6f28db35a21 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.48d1dbde-4421-4440-a766-7e73ffacd6d2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:58 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.48d1dbde-4421-4440-a766-7e73ffacd6d2 Jul 03 01:27:58 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:59 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4563e184-e4ca-47c1-bbfa-9a78781c09ec tempest-SnapshotDependencyTests-607956472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289" returned: 0 in 0.914s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4563e184-e4ca-47c1-bbfa-9a78781c09ec tempest-SnapshotDependencyTests-607956472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.dd754c14-f6c6-43e6-95c3-dbeed5e62284 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:59 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.dd754c14-f6c6-43e6-95c3-dbeed5e62284 Jul 03 01:27:59 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:59 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cbdb0a2e-a0cc-4f1b-b3bb-c6f28db35a21 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.48d1dbde-4421-4440-a766-7e73ffacd6d2" returned: 0 in 0.760s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:27:59 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-cbdb0a2e-a0cc-4f1b-b3bb-c6f28db35a21 tempest-ProjectMemberTests-1744160227 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.48d1dbde-4421-4440-a766-7e73ffacd6d2 is being set with open permissions: ugo+rw Jul 03 01:27:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cbdb0a2e-a0cc-4f1b-b3bb-c6f28db35a21 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.48d1dbde-4421-4440-a766-7e73ffacd6d2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:27:59 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.48d1dbde-4421-4440-a766-7e73ffacd6d2 Jul 03 01:27:59 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:27:59 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Jul 03 01:27:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cbdb0a2e-a0cc-4f1b-b3bb-c6f28db35a21 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.48d1dbde-4421-4440-a766-7e73ffacd6d2" returned: 0 in 0.714s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:00 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cbdb0a2e-a0cc-4f1b-b3bb-c6f28db35a21 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4563e184-e4ca-47c1-bbfa-9a78781c09ec tempest-SnapshotDependencyTests-607956472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.dd754c14-f6c6-43e6-95c3-dbeed5e62284" returned: 0 in 0.849s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4563e184-e4ca-47c1-bbfa-9a78781c09ec tempest-SnapshotDependencyTests-607956472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.dd754c14-f6c6-43e6-95c3-dbeed5e62284 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:00 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.info Jul 03 01:28:00 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:00 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.dd754c14-f6c6-43e6-95c3-dbeed5e62284 Jul 03 01:28:00 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:00 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cbdb0a2e-a0cc-4f1b-b3bb-c6f28db35a21 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.info" returned: 0 in 0.684s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:00 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-cbdb0a2e-a0cc-4f1b-b3bb-c6f28db35a21 tempest-ProjectMemberTests-1744160227 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.info is being set with open permissions: ugo+rw Jul 03 01:28:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cbdb0a2e-a0cc-4f1b-b3bb-c6f28db35a21 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:00 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.info Jul 03 01:28:00 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:00 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4563e184-e4ca-47c1-bbfa-9a78781c09ec tempest-SnapshotDependencyTests-607956472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289.dd754c14-f6c6-43e6-95c3-dbeed5e62284" returned: 0 in 0.720s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4563e184-e4ca-47c1-bbfa-9a78781c09ec tempest-SnapshotDependencyTests-607956472 None] Lock "cinder-quobyte-dd754c14-f6c6-43e6-95c3-dbeed5e62284" released by "_delete_snapshot" :: held 3.521s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4563e184-e4ca-47c1-bbfa-9a78781c09ec tempest-SnapshotDependencyTests-607956472 None] Lock "cinder-quobyte-f0a5b057-36a9-40ed-b06f-d7c72c561289" released by "delete_snapshot" :: held 3.548s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:00 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-4563e184-e4ca-47c1-bbfa-9a78781c09ec tempest-SnapshotDependencyTests-607956472 None] Created reservations ['75404639-5eb3-40c4-8f9b-91128dd05d49', 'a375bc73-4d84-4588-9f76-699a04f48c2c', '27586125-0d6f-40c2-b397-cedae135ce63', 'a9da9f90-f2b6-459d-9e37-7b1ab0d36aa7'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:00 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4563e184-e4ca-47c1-bbfa-9a78781c09ec tempest-SnapshotDependencyTests-607956472 None] Delete snapshot completed successfully. Jul 03 01:28:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4563e184-e4ca-47c1-bbfa-9a78781c09ec tempest-SnapshotDependencyTests-607956472 None] Lock "cinder-dd754c14-f6c6-43e6-95c3-dbeed5e62284-delete_snapshot" released by "delete_snapshot" :: held 3.709s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:01 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-cbdb0a2e-a0cc-4f1b-b3bb-c6f28db35a21 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.info" returned: 0 in 0.681s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-cbdb0a2e-a0cc-4f1b-b3bb-c6f28db35a21 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.675s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.513s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-640272213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64769c72-520a-46d8-a295-86c776cd8982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8828238dac7841569496db0e0bedd353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:27:50Z,use_quota=True,user_id='e94cf2fe7835400280046d098ea56eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:28:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Creating volume 64769c72-520a-46d8-a295-86c776cd8982 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:28:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:28:01 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:28:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:01 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982 1073741824 Jul 03 01:28:01 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-cbdb0a2e-a0cc-4f1b-b3bb-c6f28db35a21 tempest-ProjectMemberTests-1744160227 None] Create snapshot completed successfully Jul 03 01:28:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-29d36b5c-9c40-4f2e-924d-a7ba89a32cb7 tempest-SnapshotDependencyTests-607956472 None] Acquiring lock "cinder-f0a5b057-36a9-40ed-b06f-d7c72c561289-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-29d36b5c-9c40-4f2e-924d-a7ba89a32cb7 tempest-SnapshotDependencyTests-607956472 None] Lock "cinder-f0a5b057-36a9-40ed-b06f-d7c72c561289-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-29d36b5c-9c40-4f2e-924d-a7ba89a32cb7 tempest-SnapshotDependencyTests-607956472 None] Acquiring lock "cinder-quobyte-f0a5b057-36a9-40ed-b06f-d7c72c561289" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-29d36b5c-9c40-4f2e-924d-a7ba89a32cb7 tempest-SnapshotDependencyTests-607956472 None] Lock "cinder-quobyte-f0a5b057-36a9-40ed-b06f-d7c72c561289" acquired by "delete_volume" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:01 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f6eadc-c100-4483-9ba2-ede4b55680d7]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-29d36b5c-9c40-4f2e-924d-a7ba89a32cb7 tempest-SnapshotDependencyTests-607956472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:01 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289 Jul 03 01:28:01 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6aff8ec3-7148-4738-8021-06144d287e97 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-48d1dbde-4421-4440-a766-7e73ffacd6d2-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6aff8ec3-7148-4738-8021-06144d287e97 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-48d1dbde-4421-4440-a766-7e73ffacd6d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6aff8ec3-7148-4738-8021-06144d287e97 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6aff8ec3-7148-4738-8021-06144d287e97 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:01 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6aff8ec3-7148-4738-8021-06144d287e97 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-48d1dbde-4421-4440-a766-7e73ffacd6d2" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6aff8ec3-7148-4738-8021-06144d287e97 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-48d1dbde-4421-4440-a766-7e73ffacd6d2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6aff8ec3-7148-4738-8021-06144d287e97 tempest-ProjectMemberTests-1744160227 None] Deleting offline snapshot 48d1dbde-4421-4440-a766-7e73ffacd6d2 of volume f1b8b0af-c237-4700-a0ef-ff2f24ae9e43 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:28:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6aff8ec3-7148-4738-8021-06144d287e97 tempest-ProjectMemberTests-1744160227 None] snapshot_file for this snap is: volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.48d1dbde-4421-4440-a766-7e73ffacd6d2 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:28:02 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f028f2-dcb8-471f-98f1-17762017b11a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6aff8ec3-7148-4738-8021-06144d287e97 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.48d1dbde-4421-4440-a766-7e73ffacd6d2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:02 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.48d1dbde-4421-4440-a766-7e73ffacd6d2 Jul 03 01:28:02 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:02 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982 1073741824" returned: 0 in 1.160s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:02 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-29d36b5c-9c40-4f2e-924d-a7ba89a32cb7 tempest-SnapshotDependencyTests-607956472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289" returned: 0 in 0.942s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-29d36b5c-9c40-4f2e-924d-a7ba89a32cb7 tempest-SnapshotDependencyTests-607956472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:02 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289 Jul 03 01:28:02 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:02 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982 Jul 03 01:28:02 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:02 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6aff8ec3-7148-4738-8021-06144d287e97 tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.48d1dbde-4421-4440-a766-7e73ffacd6d2" returned: 0 in 0.907s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6aff8ec3-7148-4738-8021-06144d287e97 tempest-ProjectMemberTests-1744160227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:28:03 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[002c5c30-0e69-4851-bf7a-727d15514c9d]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6aff8ec3-7148-4738-8021-06144d287e97 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:03 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43 Jul 03 01:28:03 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:03 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-29d36b5c-9c40-4f2e-924d-a7ba89a32cb7 tempest-SnapshotDependencyTests-607956472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f0a5b057-36a9-40ed-b06f-d7c72c561289" returned: 0 in 0.821s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-29d36b5c-9c40-4f2e-924d-a7ba89a32cb7 tempest-SnapshotDependencyTests-607956472 None] Lock "cinder-quobyte-f0a5b057-36a9-40ed-b06f-d7c72c561289" released by "delete_volume" :: held 1.881s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:03 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-29d36b5c-9c40-4f2e-924d-a7ba89a32cb7 tempest-SnapshotDependencyTests-607956472 None] Created reservations ['e3a5fbc1-6a68-47ff-8ec4-1e2f5d1333ab', '8b06af56-12e5-4def-b6c2-ad400bad83cd', 'e930892c-b23e-4aaa-81cd-58311214444d', 'a1bd2b20-1128-4856-baac-a90331cd3305'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:03 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982" returned: 0 in 0.889s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] <== create_volume: return (2160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:28:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.163s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a790349-44bb-4204-9a0f-a279e317a626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64769c72-520a-46d8-a295-86c776cd8982', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfeb3b9b-3eac-47fb-8ade-43ad1a01ce40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:03 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Volume volume-64769c72-520a-46d8-a295-86c776cd8982 (64769c72-520a-46d8-a295-86c776cd8982): created successfully Jul 03 01:28:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfeb3b9b-3eac-47fb-8ade-43ad1a01ce40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:03 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Flow 'volume_create_manager' (528f79f4-dd51-498c-b20a-63187725bf1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:03 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-602fde59-c598-44cd-b22a-1d7bd008a3a8 tempest-ProjectReaderTests-1434632810 None] Created volume successfully. Jul 03 01:28:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-29d36b5c-9c40-4f2e-924d-a7ba89a32cb7 tempest-SnapshotDependencyTests-607956472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-29d36b5c-9c40-4f2e-924d-a7ba89a32cb7 tempest-SnapshotDependencyTests-607956472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-29d36b5c-9c40-4f2e-924d-a7ba89a32cb7 tempest-SnapshotDependencyTests-607956472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-29d36b5c-9c40-4f2e-924d-a7ba89a32cb7 tempest-SnapshotDependencyTests-607956472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-29d36b5c-9c40-4f2e-924d-a7ba89a32cb7 tempest-SnapshotDependencyTests-607956472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-29d36b5c-9c40-4f2e-924d-a7ba89a32cb7 tempest-SnapshotDependencyTests-607956472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:03 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:28:03 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8f500615-8e18-430c-84fe-c6cf42efdeb1 tempest-SnapshotDependencyTests-607956472 None] Acquiring lock "cinder-ddda9a27-b921-44c7-b03c-293ea9bd70a5-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8f500615-8e18-430c-84fe-c6cf42efdeb1 tempest-SnapshotDependencyTests-607956472 None] Lock "cinder-ddda9a27-b921-44c7-b03c-293ea9bd70a5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:03 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6aff8ec3-7148-4738-8021-06144d287e97 tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43" returned: 0 in 0.946s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6aff8ec3-7148-4738-8021-06144d287e97 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.48d1dbde-4421-4440-a766-7e73ffacd6d2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:03 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8f500615-8e18-430c-84fe-c6cf42efdeb1 tempest-SnapshotDependencyTests-607956472 None] Acquiring lock "cinder-quobyte-ddda9a27-b921-44c7-b03c-293ea9bd70a5" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8f500615-8e18-430c-84fe-c6cf42efdeb1 tempest-SnapshotDependencyTests-607956472 None] Lock "cinder-quobyte-ddda9a27-b921-44c7-b03c-293ea9bd70a5" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:04 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.48d1dbde-4421-4440-a766-7e73ffacd6d2 Jul 03 01:28:04 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:04 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[471538e2-cf71-4a62-ac69-f0749a942ccc]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8f500615-8e18-430c-84fe-c6cf42efdeb1 tempest-SnapshotDependencyTests-607956472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ddda9a27-b921-44c7-b03c-293ea9bd70a5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:04 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ddda9a27-b921-44c7-b03c-293ea9bd70a5 Jul 03 01:28:04 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fc907541-937c-4c29-87d0-c23bac283f98 tempest-ProjectReaderTests-1434632810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fc907541-937c-4c29-87d0-c23bac283f98 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-fc907541-937c-4c29-87d0-c23bac283f98 tempest-ProjectReaderTests-1434632810 None] Creating offline snapshot 3c94ba07-a754-42fe-b05d-6b5e0c0cc73a of volume 64769c72-520a-46d8-a295-86c776cd8982 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:28:04 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5432fed-a7f5-44f1-86ee-46ca09ec6f6a]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc907541-937c-4c29-87d0-c23bac283f98 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:04 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-29d36b5c-9c40-4f2e-924d-a7ba89a32cb7 tempest-SnapshotDependencyTests-607956472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 1.001s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:04 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-29d36b5c-9c40-4f2e-924d-a7ba89a32cb7 tempest-SnapshotDependencyTests-607956472 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:28:04 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-29d36b5c-9c40-4f2e-924d-a7ba89a32cb7 tempest-SnapshotDependencyTests-607956472 None] Deleted volume successfully. Jul 03 01:28:04 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-29d36b5c-9c40-4f2e-924d-a7ba89a32cb7 tempest-SnapshotDependencyTests-607956472 None] Lock "cinder-f0a5b057-36a9-40ed-b06f-d7c72c561289-delete_volume" released by "delete_volume" :: held 3.234s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:04 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982 Jul 03 01:28:04 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:05 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8f500615-8e18-430c-84fe-c6cf42efdeb1 tempest-SnapshotDependencyTests-607956472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ddda9a27-b921-44c7-b03c-293ea9bd70a5" returned: 0 in 1.106s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8f500615-8e18-430c-84fe-c6cf42efdeb1 tempest-SnapshotDependencyTests-607956472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ddda9a27-b921-44c7-b03c-293ea9bd70a5 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:05 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6aff8ec3-7148-4738-8021-06144d287e97 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.48d1dbde-4421-4440-a766-7e73ffacd6d2" returned: 0 in 1.193s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6aff8ec3-7148-4738-8021-06144d287e97 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.48d1dbde-4421-4440-a766-7e73ffacd6d2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:05 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ddda9a27-b921-44c7-b03c-293ea9bd70a5 Jul 03 01:28:05 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:05 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.48d1dbde-4421-4440-a766-7e73ffacd6d2 Jul 03 01:28:05 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:05 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc907541-937c-4c29-87d0-c23bac283f98 tempest-ProjectReaderTests-1434632810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982" returned: 0 in 1.007s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc907541-937c-4c29-87d0-c23bac283f98 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982.3c94ba07-a754-42fe-b05d-6b5e0c0cc73a 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:05 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982.3c94ba07-a754-42fe-b05d-6b5e0c0cc73a 1G Jul 03 01:28:05 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:05 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8f500615-8e18-430c-84fe-c6cf42efdeb1 tempest-SnapshotDependencyTests-607956472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-ddda9a27-b921-44c7-b03c-293ea9bd70a5" returned: 0 in 0.708s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8f500615-8e18-430c-84fe-c6cf42efdeb1 tempest-SnapshotDependencyTests-607956472 None] Lock "cinder-quobyte-ddda9a27-b921-44c7-b03c-293ea9bd70a5" released by "delete_volume" :: held 1.870s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:05 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-8f500615-8e18-430c-84fe-c6cf42efdeb1 tempest-SnapshotDependencyTests-607956472 None] Created reservations ['87378018-0604-41fe-82ef-953347b99d90', '28aae74f-84ec-4f3b-ad4f-8f1938b5b90f', '666ded4e-c581-4b71-9389-6dcaef902425', '185e51fb-89aa-4fda-803c-d1f8c8ca82df'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:05 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6aff8ec3-7148-4738-8021-06144d287e97 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43.48d1dbde-4421-4440-a766-7e73ffacd6d2" returned: 0 in 0.785s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6aff8ec3-7148-4738-8021-06144d287e97 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-48d1dbde-4421-4440-a766-7e73ffacd6d2" released by "_delete_snapshot" :: held 4.002s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6aff8ec3-7148-4738-8021-06144d287e97 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43" released by "delete_snapshot" :: held 4.041s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8f500615-8e18-430c-84fe-c6cf42efdeb1 tempest-SnapshotDependencyTests-607956472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8f500615-8e18-430c-84fe-c6cf42efdeb1 tempest-SnapshotDependencyTests-607956472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8f500615-8e18-430c-84fe-c6cf42efdeb1 tempest-SnapshotDependencyTests-607956472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-8f500615-8e18-430c-84fe-c6cf42efdeb1 tempest-SnapshotDependencyTests-607956472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-8f500615-8e18-430c-84fe-c6cf42efdeb1 tempest-SnapshotDependencyTests-607956472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8f500615-8e18-430c-84fe-c6cf42efdeb1 tempest-SnapshotDependencyTests-607956472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:06 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:28:06 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:06 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-6aff8ec3-7148-4738-8021-06144d287e97 tempest-ProjectMemberTests-1744160227 None] Created reservations ['428f1192-6f7c-4887-92aa-f6c9be1df20b', '00824422-586a-4e78-9821-bef6b3757b70', 'a8a23599-bcef-4b5a-96ed-3e9671bc1970', '5d5aa662-b12d-4753-b7d1-cf2179db2c59'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:06 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6aff8ec3-7148-4738-8021-06144d287e97 tempest-ProjectMemberTests-1744160227 None] Delete snapshot completed successfully. Jul 03 01:28:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6aff8ec3-7148-4738-8021-06144d287e97 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-48d1dbde-4421-4440-a766-7e73ffacd6d2-delete_snapshot" released by "delete_snapshot" :: held 4.313s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ec900c9c-ae6e-495b-ba11-5f24cb51aca1 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ec900c9c-ae6e-495b-ba11-5f24cb51aca1 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ec900c9c-ae6e-495b-ba11-5f24cb51aca1 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ec900c9c-ae6e-495b-ba11-5f24cb51aca1 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43" acquired by "delete_volume" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:06 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81a63c8-30a8-4c89-b895-a60ca77ccd79]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ec900c9c-ae6e-495b-ba11-5f24cb51aca1 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:06 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc907541-937c-4c29-87d0-c23bac283f98 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982.3c94ba07-a754-42fe-b05d-6b5e0c0cc73a 1G" returned: 0 in 1.015s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc907541-937c-4c29-87d0-c23bac283f98 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64769c72-520a-46d8-a295-86c776cd8982 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982.3c94ba07-a754-42fe-b05d-6b5e0c0cc73a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:06 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64769c72-520a-46d8-a295-86c776cd8982 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982.3c94ba07-a754-42fe-b05d-6b5e0c0cc73a Jul 03 01:28:06 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:06 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43 Jul 03 01:28:06 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:06 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-8f500615-8e18-430c-84fe-c6cf42efdeb1 tempest-SnapshotDependencyTests-607956472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.867s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:06 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-8f500615-8e18-430c-84fe-c6cf42efdeb1 tempest-SnapshotDependencyTests-607956472 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:28:06 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-8f500615-8e18-430c-84fe-c6cf42efdeb1 tempest-SnapshotDependencyTests-607956472 None] Deleted volume successfully. Jul 03 01:28:06 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=127,cinder:INSERT=46,cinder:UPDATE=184,cinder:DELETE=15 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:28:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-8f500615-8e18-430c-84fe-c6cf42efdeb1 tempest-SnapshotDependencyTests-607956472 None] Lock "cinder-ddda9a27-b921-44c7-b03c-293ea9bd70a5-delete_volume" released by "delete_volume" :: held 3.039s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:07 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc907541-937c-4c29-87d0-c23bac283f98 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64769c72-520a-46d8-a295-86c776cd8982 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982.3c94ba07-a754-42fe-b05d-6b5e0c0cc73a" returned: 0 in 0.849s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:07 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-fc907541-937c-4c29-87d0-c23bac283f98 tempest-ProjectReaderTests-1434632810 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982.3c94ba07-a754-42fe-b05d-6b5e0c0cc73a is being set with open permissions: ugo+rw Jul 03 01:28:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc907541-937c-4c29-87d0-c23bac283f98 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982.3c94ba07-a754-42fe-b05d-6b5e0c0cc73a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:07 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982.3c94ba07-a754-42fe-b05d-6b5e0c0cc73a Jul 03 01:28:07 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:07 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ec900c9c-ae6e-495b-ba11-5f24cb51aca1 tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43" returned: 0 in 1.013s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ec900c9c-ae6e-495b-ba11-5f24cb51aca1 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:07 devstack sudo[108196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43 Jul 03 01:28:07 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:08 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc907541-937c-4c29-87d0-c23bac283f98 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982.3c94ba07-a754-42fe-b05d-6b5e0c0cc73a" returned: 0 in 0.800s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:08 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ec900c9c-ae6e-495b-ba11-5f24cb51aca1 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43" returned: 0 in 0.770s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc907541-937c-4c29-87d0-c23bac283f98 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ec900c9c-ae6e-495b-ba11-5f24cb51aca1 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43" released by "delete_volume" :: held 1.904s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:08 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982.info Jul 03 01:28:08 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:08 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-ec900c9c-ae6e-495b-ba11-5f24cb51aca1 tempest-ProjectMemberTests-1744160227 None] Created reservations ['5e3261f5-038a-406c-a2a4-4cb6a95815e8', '9f4c3d78-cce7-4fd7-b7f1-73c7a3fd712a', 'c16bd68c-e56b-4e0f-85c9-e3a2f8970892', '03332a83-0773-4711-87f6-d7aed61d5ea2'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:08 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=172,cinder:DELETE=15,cinder:SELECT=135,cinder:INSERT=46 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:28:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ec900c9c-ae6e-495b-ba11-5f24cb51aca1 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ec900c9c-ae6e-495b-ba11-5f24cb51aca1 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ec900c9c-ae6e-495b-ba11-5f24cb51aca1 tempest-ProjectMemberTests-1744160227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ec900c9c-ae6e-495b-ba11-5f24cb51aca1 tempest-ProjectMemberTests-1744160227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ec900c9c-ae6e-495b-ba11-5f24cb51aca1 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ec900c9c-ae6e-495b-ba11-5f24cb51aca1 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:08 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:28:08 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:09 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc907541-937c-4c29-87d0-c23bac283f98 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982.info" returned: 0 in 0.932s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:09 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-fc907541-937c-4c29-87d0-c23bac283f98 tempest-ProjectReaderTests-1434632810 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982.info is being set with open permissions: ugo+rw Jul 03 01:28:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc907541-937c-4c29-87d0-c23bac283f98 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:09 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982.info Jul 03 01:28:09 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:09 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:28:09 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Flow 'volume_create_manager' (991bedc3-2542-4c18-a744-d623bd34ec4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (067246e3-efbd-445c-ab60-a0d4d8e70df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ec900c9c-ae6e-495b-ba11-5f24cb51aca1 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.807s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:09 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-ec900c9c-ae6e-495b-ba11-5f24cb51aca1 tempest-ProjectMemberTests-1744160227 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:28:09 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ec900c9c-ae6e-495b-ba11-5f24cb51aca1 tempest-ProjectMemberTests-1744160227 None] Deleted volume successfully. Jul 03 01:28:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (067246e3-efbd-445c-ab60-a0d4d8e70df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1868576548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cce6f55-cec3-4a37-824e-e2df5f2f7152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970504d68ec94910bf67dae1490927d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:09Z,use_quota=True,user_id='bc9ce9ff10bf4b2cada6d0ec88b24ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed289e19-1b42-48f0-a2c4-84aac601a65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed289e19-1b42-48f0-a2c4-84aac601a65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d1592e-d875-439c-999e-05f2f4eac7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d1592e-d875-439c-999e-05f2f4eac7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cce6f55-cec3-4a37-824e-e2df5f2f7152', 'volume_name': 'volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9289350f-62d3-4bba-b183-9d621f179cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9289350f-62d3-4bba-b183-9d621f179cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4707c7fe-393a-4b9b-bf83-84f80ed11393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:09 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Volume 2cce6f55-cec3-4a37-824e-e2df5f2f7152: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152', 'volume_size': 1} Jul 03 01:28:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ec900c9c-ae6e-495b-ba11-5f24cb51aca1 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-f1b8b0af-c237-4700-a0ef-ff2f24ae9e43-delete_volume" released by "delete_volume" :: held 3.085s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:10 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fc907541-937c-4c29-87d0-c23bac283f98 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982.info" returned: 0 in 0.833s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fc907541-937c-4c29-87d0-c23bac283f98 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.563s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.664s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1868576548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cce6f55-cec3-4a37-824e-e2df5f2f7152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970504d68ec94910bf67dae1490927d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:09Z,use_quota=True,user_id='bc9ce9ff10bf4b2cada6d0ec88b24ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:28:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Creating volume 2cce6f55-cec3-4a37-824e-e2df5f2f7152 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:28:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:28:10 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:28:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:10 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152 1073741824 Jul 03 01:28:10 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:10 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-fc907541-937c-4c29-87d0-c23bac283f98 tempest-ProjectReaderTests-1434632810 None] Create snapshot completed successfully Jul 03 01:28:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4677b308-6c61-4ff4-9aaa-caa505ae04ad tempest-ProjectReaderTests-1434632810 None] Acquiring lock "cinder-3c94ba07-a754-42fe-b05d-6b5e0c0cc73a-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4677b308-6c61-4ff4-9aaa-caa505ae04ad tempest-ProjectReaderTests-1434632810 None] Lock "cinder-3c94ba07-a754-42fe-b05d-6b5e0c0cc73a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4677b308-6c61-4ff4-9aaa-caa505ae04ad tempest-ProjectReaderTests-1434632810 None] Acquiring lock "cinder-quobyte-64769c72-520a-46d8-a295-86c776cd8982" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4677b308-6c61-4ff4-9aaa-caa505ae04ad tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-64769c72-520a-46d8-a295-86c776cd8982" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4677b308-6c61-4ff4-9aaa-caa505ae04ad tempest-ProjectReaderTests-1434632810 None] Acquiring lock "cinder-quobyte-3c94ba07-a754-42fe-b05d-6b5e0c0cc73a" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:10 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4677b308-6c61-4ff4-9aaa-caa505ae04ad tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-3c94ba07-a754-42fe-b05d-6b5e0c0cc73a" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4677b308-6c61-4ff4-9aaa-caa505ae04ad tempest-ProjectReaderTests-1434632810 None] Deleting offline snapshot 3c94ba07-a754-42fe-b05d-6b5e0c0cc73a of volume 64769c72-520a-46d8-a295-86c776cd8982 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:28:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4677b308-6c61-4ff4-9aaa-caa505ae04ad tempest-ProjectReaderTests-1434632810 None] snapshot_file for this snap is: volume-64769c72-520a-46d8-a295-86c776cd8982.3c94ba07-a754-42fe-b05d-6b5e0c0cc73a {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:28:11 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffdf5fe-661f-4880-87ba-9a952961dc73]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4677b308-6c61-4ff4-9aaa-caa505ae04ad tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982.3c94ba07-a754-42fe-b05d-6b5e0c0cc73a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:11 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982.3c94ba07-a754-42fe-b05d-6b5e0c0cc73a Jul 03 01:28:11 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:11 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152 1073741824" returned: 0 in 0.997s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:11 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152 Jul 03 01:28:11 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:11 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4677b308-6c61-4ff4-9aaa-caa505ae04ad tempest-ProjectReaderTests-1434632810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982.3c94ba07-a754-42fe-b05d-6b5e0c0cc73a" returned: 0 in 0.867s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4677b308-6c61-4ff4-9aaa-caa505ae04ad tempest-ProjectReaderTests-1434632810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64769c72-520a-46d8-a295-86c776cd8982(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:28:11 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f69b34-614c-4cfe-a706-a4ad4ab27673]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4677b308-6c61-4ff4-9aaa-caa505ae04ad tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:11 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152" returned: 0 in 0.761s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:28:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:11 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4707c7fe-393a-4b9b-bf83-84f80ed11393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b9b80a-4ca4-4401-adb8-967b0bd7b069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:12 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Volume volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152 (2cce6f55-cec3-4a37-824e-e2df5f2f7152): created successfully Jul 03 01:28:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b9b80a-4ca4-4401-adb8-967b0bd7b069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Flow 'volume_create_manager' (991bedc3-2542-4c18-a744-d623bd34ec4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:12 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-462cc1d8-d5e4-43c3-bdbc-2c63fc9379c0 tempest-ProjectMemberTests-1744160227 None] Created volume successfully. Jul 03 01:28:12 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982 Jul 03 01:28:12 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f06edc4a-353e-4266-974c-90c47c5a5612 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f06edc4a-353e-4266-974c-90c47c5a5612 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f06edc4a-353e-4266-974c-90c47c5a5612 tempest-ProjectMemberTests-1744160227 None] Creating offline snapshot 24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0 of volume 2cce6f55-cec3-4a37-824e-e2df5f2f7152 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:28:12 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c0b210-b135-4424-ba12-517dd51c828c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f06edc4a-353e-4266-974c-90c47c5a5612 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:12 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4677b308-6c61-4ff4-9aaa-caa505ae04ad tempest-ProjectReaderTests-1434632810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982" returned: 0 in 0.962s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4677b308-6c61-4ff4-9aaa-caa505ae04ad tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982.3c94ba07-a754-42fe-b05d-6b5e0c0cc73a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:12 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152 Jul 03 01:28:12 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:28:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:12 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982.3c94ba07-a754-42fe-b05d-6b5e0c0cc73a Jul 03 01:28:12 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:12 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:28:12 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:13 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f06edc4a-353e-4266-974c-90c47c5a5612 tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152" returned: 0 in 0.919s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f06edc4a-353e-4266-974c-90c47c5a5612 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:13 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0 1G Jul 03 01:28:13 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:13 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4677b308-6c61-4ff4-9aaa-caa505ae04ad tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982.3c94ba07-a754-42fe-b05d-6b5e0c0cc73a" returned: 0 in 0.891s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4677b308-6c61-4ff4-9aaa-caa505ae04ad tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982.3c94ba07-a754-42fe-b05d-6b5e0c0cc73a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:13 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982.3c94ba07-a754-42fe-b05d-6b5e0c0cc73a Jul 03 01:28:13 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:13 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.937s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:28:13 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:28:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 29 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:28:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:28:14 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4677b308-6c61-4ff4-9aaa-caa505ae04ad tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982.3c94ba07-a754-42fe-b05d-6b5e0c0cc73a" returned: 0 in 0.868s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4677b308-6c61-4ff4-9aaa-caa505ae04ad tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-3c94ba07-a754-42fe-b05d-6b5e0c0cc73a" released by "_delete_snapshot" :: held 3.723s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4677b308-6c61-4ff4-9aaa-caa505ae04ad tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-64769c72-520a-46d8-a295-86c776cd8982" released by "delete_snapshot" :: held 3.761s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:14 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-4677b308-6c61-4ff4-9aaa-caa505ae04ad tempest-ProjectReaderTests-1434632810 None] Created reservations ['24118003-2a4e-4f36-9966-c4b14bc6459e', '513131a3-74d5-4487-b4c6-fb7ad978dd7c', 'fb48bd5c-d607-452a-ba44-9fea86ad4190', '7e32fb7a-f90f-4f32-a6f7-d9f5c925ce68'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:14 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f06edc4a-353e-4266-974c-90c47c5a5612 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0 1G" returned: 0 in 1.094s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f06edc4a-353e-4266-974c-90c47c5a5612 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:14 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0 Jul 03 01:28:14 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:14 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4677b308-6c61-4ff4-9aaa-caa505ae04ad tempest-ProjectReaderTests-1434632810 None] Delete snapshot completed successfully. Jul 03 01:28:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4677b308-6c61-4ff4-9aaa-caa505ae04ad tempest-ProjectReaderTests-1434632810 None] Lock "cinder-3c94ba07-a754-42fe-b05d-6b5e0c0cc73a-delete_snapshot" released by "delete_snapshot" :: held 3.951s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-81e23a0d-2f04-44f6-bfb7-244ec58b381e tempest-ProjectReaderTests-1434632810 None] Acquiring lock "cinder-64769c72-520a-46d8-a295-86c776cd8982-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-81e23a0d-2f04-44f6-bfb7-244ec58b381e tempest-ProjectReaderTests-1434632810 None] Lock "cinder-64769c72-520a-46d8-a295-86c776cd8982-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-81e23a0d-2f04-44f6-bfb7-244ec58b381e tempest-ProjectReaderTests-1434632810 None] Acquiring lock "cinder-quobyte-64769c72-520a-46d8-a295-86c776cd8982" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-81e23a0d-2f04-44f6-bfb7-244ec58b381e tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-64769c72-520a-46d8-a295-86c776cd8982" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:15 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f5c630-9a3e-4874-b919-d147efd75abd]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-81e23a0d-2f04-44f6-bfb7-244ec58b381e tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:15 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982 Jul 03 01:28:15 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:15 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f06edc4a-353e-4266-974c-90c47c5a5612 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0" returned: 0 in 0.858s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:15 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-f06edc4a-353e-4266-974c-90c47c5a5612 tempest-ProjectMemberTests-1744160227 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0 is being set with open permissions: ugo+rw Jul 03 01:28:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f06edc4a-353e-4266-974c-90c47c5a5612 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:15 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0 Jul 03 01:28:15 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:16 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-81e23a0d-2f04-44f6-bfb7-244ec58b381e tempest-ProjectReaderTests-1434632810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982" returned: 0 in 0.912s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-81e23a0d-2f04-44f6-bfb7-244ec58b381e tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:16 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982 Jul 03 01:28:16 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:16 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f06edc4a-353e-4266-974c-90c47c5a5612 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0" returned: 0 in 0.799s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f06edc4a-353e-4266-974c-90c47c5a5612 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:16 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.info Jul 03 01:28:16 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:17 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-81e23a0d-2f04-44f6-bfb7-244ec58b381e tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-64769c72-520a-46d8-a295-86c776cd8982" returned: 0 in 0.795s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-81e23a0d-2f04-44f6-bfb7-244ec58b381e tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-64769c72-520a-46d8-a295-86c776cd8982" released by "delete_volume" :: held 1.784s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:17 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:17 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-81e23a0d-2f04-44f6-bfb7-244ec58b381e tempest-ProjectReaderTests-1434632810 None] Created reservations ['bba8c83e-9c22-49f4-9971-23326fc8782c', '7edae99a-b7e1-406e-92ed-bef1f63a9558', 'ef682d5c-f00b-4ee1-be17-56db83c21c8e', '31e5b3ff-966a-4713-927e-c8fcd9823b18'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f06edc4a-353e-4266-974c-90c47c5a5612 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.info" returned: 0 in 0.708s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:17 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-f06edc4a-353e-4266-974c-90c47c5a5612 tempest-ProjectMemberTests-1744160227 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.info is being set with open permissions: ugo+rw Jul 03 01:28:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f06edc4a-353e-4266-974c-90c47c5a5612 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:17 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.info Jul 03 01:28:17 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-81e23a0d-2f04-44f6-bfb7-244ec58b381e tempest-ProjectReaderTests-1434632810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-81e23a0d-2f04-44f6-bfb7-244ec58b381e tempest-ProjectReaderTests-1434632810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-81e23a0d-2f04-44f6-bfb7-244ec58b381e tempest-ProjectReaderTests-1434632810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-81e23a0d-2f04-44f6-bfb7-244ec58b381e tempest-ProjectReaderTests-1434632810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-81e23a0d-2f04-44f6-bfb7-244ec58b381e tempest-ProjectReaderTests-1434632810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-81e23a0d-2f04-44f6-bfb7-244ec58b381e tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:17 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:28:17 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:18 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f06edc4a-353e-4266-974c-90c47c5a5612 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.info" returned: 0 in 0.816s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f06edc4a-353e-4266-974c-90c47c5a5612 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.313s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:18 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:18 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f06edc4a-353e-4266-974c-90c47c5a5612 tempest-ProjectMemberTests-1744160227 None] Create snapshot completed successfully Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-81e23a0d-2f04-44f6-bfb7-244ec58b381e tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.790s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Flow 'volume_create_manager' (5a5edbce-9b22-486e-821c-81b218ac5f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217331c8-ea47-4a57-b515-e9b66ec47354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-81e23a0d-2f04-44f6-bfb7-244ec58b381e tempest-ProjectReaderTests-1434632810 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:28:18 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-81e23a0d-2f04-44f6-bfb7-244ec58b381e tempest-ProjectReaderTests-1434632810 None] Deleted volume successfully. Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217331c8-ea47-4a57-b515-e9b66ec47354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2034535428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8828238dac7841569496db0e0bedd353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:18Z,use_quota=True,user_id='e94cf2fe7835400280046d098ea56eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67061713-ebf1-4d90-afd4-0f60049b4735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67061713-ebf1-4d90-afd4-0f60049b4735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fad011c-8539-4a9b-a1b0-851ad64547d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fad011c-8539-4a9b-a1b0-851ad64547d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f', 'volume_name': 'volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7069da3-0820-49ad-94f2-a6f70f58287c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7069da3-0820-49ad-94f2-a6f70f58287c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17a6720-ea13-4952-b110-43362d23409e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:18 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Volume f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f', 'volume_size': 1} Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2034535428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8828238dac7841569496db0e0bedd353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:18Z,use_quota=True,user_id='e94cf2fe7835400280046d098ea56eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Creating volume f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:28:18 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-81e23a0d-2f04-44f6-bfb7-244ec58b381e tempest-ProjectReaderTests-1434632810 None] Lock "cinder-64769c72-520a-46d8-a295-86c776cd8982-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:18 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f 1073741824 Jul 03 01:28:18 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1588d801-c8ad-472e-8de2-09565a82396f tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:19 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f 1073741824" returned: 0 in 0.910s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1588d801-c8ad-472e-8de2-09565a82396f tempest-ProjectMemberTests-1744160227 None] Lock "cinder-24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1588d801-c8ad-472e-8de2-09565a82396f tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-2cce6f55-cec3-4a37-824e-e2df5f2f7152" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1588d801-c8ad-472e-8de2-09565a82396f tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-2cce6f55-cec3-4a37-824e-e2df5f2f7152" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1588d801-c8ad-472e-8de2-09565a82396f tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:19 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1588d801-c8ad-472e-8de2-09565a82396f tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-1588d801-c8ad-472e-8de2-09565a82396f tempest-ProjectMemberTests-1744160227 None] Deleting offline snapshot 24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0 of volume 2cce6f55-cec3-4a37-824e-e2df5f2f7152 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:28:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-1588d801-c8ad-472e-8de2-09565a82396f tempest-ProjectMemberTests-1744160227 None] snapshot_file for this snap is: volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:28:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:19 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd363506-9d72-4427-9875-55bdd1ac5928]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1588d801-c8ad-472e-8de2-09565a82396f tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:19 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f Jul 03 01:28:19 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:19 devstack sudo[108294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0 Jul 03 01:28:19 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:19 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f" returned: 0 in 0.656s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:28:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17a6720-ea13-4952-b110-43362d23409e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbd7af46-be92-4246-a70b-009756adaa67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:19 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Volume volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f (f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f): created successfully Jul 03 01:28:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbd7af46-be92-4246-a70b-009756adaa67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:19 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Flow 'volume_create_manager' (5a5edbce-9b22-486e-821c-81b218ac5f83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:19 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ac13e739-f9b0-4bc4-96c3-1d3e2f22a6ff tempest-ProjectReaderTests-1434632810 None] Created volume successfully. Jul 03 01:28:19 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1588d801-c8ad-472e-8de2-09565a82396f tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0" returned: 0 in 0.781s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:19 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-1588d801-c8ad-472e-8de2-09565a82396f tempest-ProjectMemberTests-1744160227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:28:20 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b833f9a0-349d-47bc-9c9a-e6faf5855b65]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1588d801-c8ad-472e-8de2-09565a82396f tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:20 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152 Jul 03 01:28:20 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e104b90-1dcc-4912-aac4-f6d065ba886c tempest-ProjectReaderTests-1434632810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e104b90-1dcc-4912-aac4-f6d065ba886c tempest-ProjectReaderTests-1434632810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-9e104b90-1dcc-4912-aac4-f6d065ba886c tempest-ProjectReaderTests-1434632810 None] Creating offline snapshot e899474c-5b27-4d72-b1d5-83438036312d of volume f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:28:20 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[529bf092-c00a-45b1-bf9f-54585a5913ce]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e104b90-1dcc-4912-aac4-f6d065ba886c tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:20 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f Jul 03 01:28:20 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:20 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1588d801-c8ad-472e-8de2-09565a82396f tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152" returned: 0 in 0.832s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1588d801-c8ad-472e-8de2-09565a82396f tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:20 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0 Jul 03 01:28:20 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:21 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e104b90-1dcc-4912-aac4-f6d065ba886c tempest-ProjectReaderTests-1434632810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f" returned: 0 in 0.854s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e104b90-1dcc-4912-aac4-f6d065ba886c tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f.e899474c-5b27-4d72-b1d5-83438036312d 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:21 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f.e899474c-5b27-4d72-b1d5-83438036312d 1G Jul 03 01:28:21 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:21 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1588d801-c8ad-472e-8de2-09565a82396f tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0" returned: 0 in 0.774s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1588d801-c8ad-472e-8de2-09565a82396f tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:21 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0 Jul 03 01:28:21 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:22 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e104b90-1dcc-4912-aac4-f6d065ba886c tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f.e899474c-5b27-4d72-b1d5-83438036312d 1G" returned: 0 in 0.828s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e104b90-1dcc-4912-aac4-f6d065ba886c tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f.e899474c-5b27-4d72-b1d5-83438036312d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:22 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f.e899474c-5b27-4d72-b1d5-83438036312d Jul 03 01:28:22 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:22 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1588d801-c8ad-472e-8de2-09565a82396f tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152.24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0" returned: 0 in 0.696s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1588d801-c8ad-472e-8de2-09565a82396f tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0" released by "_delete_snapshot" :: held 3.196s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1588d801-c8ad-472e-8de2-09565a82396f tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-2cce6f55-cec3-4a37-824e-e2df5f2f7152" released by "delete_snapshot" :: held 3.224s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:22 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-1588d801-c8ad-472e-8de2-09565a82396f tempest-ProjectMemberTests-1744160227 None] Created reservations ['2a063458-27ed-497c-96e5-880c21be6d3b', 'c01f4ee4-aa56-43fe-bb8e-4f432a898535', '594cdc0c-132f-4e2c-a281-915b3153f3e1', '920584f4-9230-4c1c-b427-b42df6d3e821'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:22 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1588d801-c8ad-472e-8de2-09565a82396f tempest-ProjectMemberTests-1744160227 None] Delete snapshot completed successfully. Jul 03 01:28:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-1588d801-c8ad-472e-8de2-09565a82396f tempest-ProjectMemberTests-1744160227 None] Lock "cinder-24eb820b-6ac8-43ce-8d1a-4bca96dfb4d0-delete_snapshot" released by "delete_snapshot" :: held 3.372s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:22 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e104b90-1dcc-4912-aac4-f6d065ba886c tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f.e899474c-5b27-4d72-b1d5-83438036312d" returned: 0 in 0.760s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:22 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-9e104b90-1dcc-4912-aac4-f6d065ba886c tempest-ProjectReaderTests-1434632810 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f.e899474c-5b27-4d72-b1d5-83438036312d is being set with open permissions: ugo+rw Jul 03 01:28:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e104b90-1dcc-4912-aac4-f6d065ba886c tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f.e899474c-5b27-4d72-b1d5-83438036312d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:22 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f.e899474c-5b27-4d72-b1d5-83438036312d Jul 03 01:28:22 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4906d411-127f-4c85-8b33-a74e826496ef tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-2cce6f55-cec3-4a37-824e-e2df5f2f7152-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4906d411-127f-4c85-8b33-a74e826496ef tempest-ProjectMemberTests-1744160227 None] Lock "cinder-2cce6f55-cec3-4a37-824e-e2df5f2f7152-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4906d411-127f-4c85-8b33-a74e826496ef tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-2cce6f55-cec3-4a37-824e-e2df5f2f7152" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4906d411-127f-4c85-8b33-a74e826496ef tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-2cce6f55-cec3-4a37-824e-e2df5f2f7152" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:23 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b961a6-938c-4059-9c12-a199255ab337]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4906d411-127f-4c85-8b33-a74e826496ef tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:23 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e104b90-1dcc-4912-aac4-f6d065ba886c tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f.e899474c-5b27-4d72-b1d5-83438036312d" returned: 0 in 0.738s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e104b90-1dcc-4912-aac4-f6d065ba886c tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:23 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f.info Jul 03 01:28:23 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:23 devstack sudo[108370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152 Jul 03 01:28:23 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:24 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:24 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4906d411-127f-4c85-8b33-a74e826496ef tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152" returned: 0 in 0.834s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e104b90-1dcc-4912-aac4-f6d065ba886c tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f.info" returned: 0 in 0.735s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4906d411-127f-4c85-8b33-a74e826496ef tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:24 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-9e104b90-1dcc-4912-aac4-f6d065ba886c tempest-ProjectReaderTests-1434632810 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f.info is being set with open permissions: ugo+rw Jul 03 01:28:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e104b90-1dcc-4912-aac4-f6d065ba886c tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:24 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152 Jul 03 01:28:24 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:24 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f.info Jul 03 01:28:24 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:24 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e104b90-1dcc-4912-aac4-f6d065ba886c tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1d3c2d8-4eff-4075-8c52-ba9fe9550f6f.info" returned: 0 in 0.651s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:24 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e104b90-1dcc-4912-aac4-f6d065ba886c tempest-ProjectReaderTests-1434632810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.678s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4906d411-127f-4c85-8b33-a74e826496ef tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2cce6f55-cec3-4a37-824e-e2df5f2f7152" returned: 0 in 0.683s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4906d411-127f-4c85-8b33-a74e826496ef tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-2cce6f55-cec3-4a37-824e-e2df5f2f7152" released by "delete_volume" :: held 1.579s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:25 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9e104b90-1dcc-4912-aac4-f6d065ba886c tempest-ProjectReaderTests-1434632810 None] Create snapshot completed successfully Jul 03 01:28:25 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-4906d411-127f-4c85-8b33-a74e826496ef tempest-ProjectMemberTests-1744160227 None] Created reservations ['441d368f-f324-4e47-8394-526c59a9ce98', '17bdc2ce-583f-49ee-ad0d-c1e844ef638f', '17e20e83-bd3e-458b-b998-493ac36246ba', '910398ed-acbd-4131-bbc5-0bd4c2a51b40'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4906d411-127f-4c85-8b33-a74e826496ef tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4906d411-127f-4c85-8b33-a74e826496ef tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4906d411-127f-4c85-8b33-a74e826496ef tempest-ProjectMemberTests-1744160227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:25 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-4906d411-127f-4c85-8b33-a74e826496ef tempest-ProjectMemberTests-1744160227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-4906d411-127f-4c85-8b33-a74e826496ef tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4906d411-127f-4c85-8b33-a74e826496ef tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:25 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:28:25 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d02374f3-73b0-434c-bf0d-a15411c2928c tempest-ProjectReaderTests-1434632810 None] Acquiring lock "cinder-e899474c-5b27-4d72-b1d5-83438036312d-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d02374f3-73b0-434c-bf0d-a15411c2928c tempest-ProjectReaderTests-1434632810 None] Lock "cinder-e899474c-5b27-4d72-b1d5-83438036312d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:25 devstack cinder-volume[86772]: INFO cinder.message.api [None req-d02374f3-73b0-434c-bf0d-a15411c2928c tempest-ProjectReaderTests-1434632810 None] Creating message record for request_id = req-d02374f3-73b0-434c-bf0d-a15411c2928c Jul 03 01:28:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-d02374f3-73b0-434c-bf0d-a15411c2928c tempest-ProjectReaderTests-1434632810 None] Lock "cinder-e899474c-5b27-4d72-b1d5-83438036312d-delete_snapshot" released by "delete_snapshot" :: held 0.047s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server [None req-d02374f3-73b0-434c-bf0d-a15411c2928c tempest-ProjectReaderTests-1434632810 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server raise self.value Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 01:28:25 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server Jul 03 01:28:25 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4906d411-127f-4c85-8b33-a74e826496ef tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.701s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:25 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-4906d411-127f-4c85-8b33-a74e826496ef tempest-ProjectMemberTests-1744160227 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:28:25 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4906d411-127f-4c85-8b33-a74e826496ef tempest-ProjectMemberTests-1744160227 None] Deleted volume successfully. Jul 03 01:28:25 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4906d411-127f-4c85-8b33-a74e826496ef tempest-ProjectMemberTests-1744160227 None] Lock "cinder-2cce6f55-cec3-4a37-824e-e2df5f2f7152-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:26 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:28:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Flow 'volume_create_manager' (fc65da11-8018-4be2-9b0d-35456181a807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e36fbb6-c854-44d7-a11a-90b7dfd92f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e36fbb6-c854-44d7-a11a-90b7dfd92f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-49507314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c66216f-b29c-46dc-858f-7d229c9f3d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970504d68ec94910bf67dae1490927d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:26Z,use_quota=True,user_id='bc9ce9ff10bf4b2cada6d0ec88b24ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af35bfcd-5c43-4a26-adf3-1bcae43b9ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af35bfcd-5c43-4a26-adf3-1bcae43b9ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4054f763-9207-45be-a2f3-9e9638012b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4054f763-9207-45be-a2f3-9e9638012b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c66216f-b29c-46dc-858f-7d229c9f3d73', 'volume_name': 'volume-2c66216f-b29c-46dc-858f-7d229c9f3d73', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b99895-faef-4f23-8e7e-c7e7002e4f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b99895-faef-4f23-8e7e-c7e7002e4f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8064a870-6d35-412f-bc71-f19a5b25ac97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:26 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Volume 2c66216f-b29c-46dc-858f-7d229c9f3d73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c66216f-b29c-46dc-858f-7d229c9f3d73', 'volume_size': 1} Jul 03 01:28:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-49507314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c66216f-b29c-46dc-858f-7d229c9f3d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970504d68ec94910bf67dae1490927d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:26Z,use_quota=True,user_id='bc9ce9ff10bf4b2cada6d0ec88b24ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:28:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Creating volume 2c66216f-b29c-46dc-858f-7d229c9f3d73 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:28:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:28:26 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:28:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:26 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73 1073741824 Jul 03 01:28:26 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:27 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73 1073741824" returned: 0 in 0.886s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:27 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73 Jul 03 01:28:27 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:27 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73" returned: 0 in 0.738s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:28:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8064a870-6d35-412f-bc71-f19a5b25ac97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c66216f-b29c-46dc-858f-7d229c9f3d73', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac06f19-f658-4d6d-a725-2ecf367e9174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:27 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Volume volume-2c66216f-b29c-46dc-858f-7d229c9f3d73 (2c66216f-b29c-46dc-858f-7d229c9f3d73): created successfully Jul 03 01:28:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac06f19-f658-4d6d-a725-2ecf367e9174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Flow 'volume_create_manager' (fc65da11-8018-4be2-9b0d-35456181a807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:27 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9eadb1fb-98ca-44b0-8b5f-bee40d0b48d3 tempest-ProjectMemberTests-1744160227 None] Created volume successfully. Jul 03 01:28:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fa693472-1f24-49da-86bc-417938f15ecb tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fa693472-1f24-49da-86bc-417938f15ecb tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:28 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-fa693472-1f24-49da-86bc-417938f15ecb tempest-ProjectMemberTests-1744160227 None] Creating offline snapshot 72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78 of volume 2c66216f-b29c-46dc-858f-7d229c9f3d73 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:28:28 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0d0ba4-2f45-40ae-877d-52833ac9fae3]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fa693472-1f24-49da-86bc-417938f15ecb tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:28 devstack sudo[108401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73 Jul 03 01:28:28 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:29 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fa693472-1f24-49da-86bc-417938f15ecb tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73" returned: 0 in 0.802s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fa693472-1f24-49da-86bc-417938f15ecb tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:29 devstack sudo[108406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78 1G Jul 03 01:28:29 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:29 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fa693472-1f24-49da-86bc-417938f15ecb tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78 1G" returned: 0 in 0.813s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fa693472-1f24-49da-86bc-417938f15ecb tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c66216f-b29c-46dc-858f-7d229c9f3d73 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:29 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c66216f-b29c-46dc-858f-7d229c9f3d73 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78 Jul 03 01:28:29 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:30 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fa693472-1f24-49da-86bc-417938f15ecb tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c66216f-b29c-46dc-858f-7d229c9f3d73 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78" returned: 0 in 0.728s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:30 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-fa693472-1f24-49da-86bc-417938f15ecb tempest-ProjectMemberTests-1744160227 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78 is being set with open permissions: ugo+rw Jul 03 01:28:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fa693472-1f24-49da-86bc-417938f15ecb tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:30 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78 Jul 03 01:28:30 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:31 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fa693472-1f24-49da-86bc-417938f15ecb tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78" returned: 0 in 0.671s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fa693472-1f24-49da-86bc-417938f15ecb tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:31 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.info Jul 03 01:28:31 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:32 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fa693472-1f24-49da-86bc-417938f15ecb tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.info" returned: 0 in 0.697s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:32 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-fa693472-1f24-49da-86bc-417938f15ecb tempest-ProjectMemberTests-1744160227 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.info is being set with open permissions: ugo+rw Jul 03 01:28:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fa693472-1f24-49da-86bc-417938f15ecb tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:32 devstack sudo[108422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.info Jul 03 01:28:32 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:32 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-fa693472-1f24-49da-86bc-417938f15ecb tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.info" returned: 0 in 0.717s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-fa693472-1f24-49da-86bc-417938f15ecb tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.514s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:32 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-fa693472-1f24-49da-86bc-417938f15ecb tempest-ProjectMemberTests-1744160227 None] Create snapshot completed successfully Jul 03 01:28:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e1fe8460-b4d4-472e-ba29-2e70470bf5ac tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e1fe8460-b4d4-472e-ba29-2e70470bf5ac tempest-ProjectMemberTests-1744160227 None] Lock "cinder-72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e1fe8460-b4d4-472e-ba29-2e70470bf5ac tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-2c66216f-b29c-46dc-858f-7d229c9f3d73" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e1fe8460-b4d4-472e-ba29-2e70470bf5ac tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-2c66216f-b29c-46dc-858f-7d229c9f3d73" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e1fe8460-b4d4-472e-ba29-2e70470bf5ac tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e1fe8460-b4d4-472e-ba29-2e70470bf5ac tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e1fe8460-b4d4-472e-ba29-2e70470bf5ac tempest-ProjectMemberTests-1744160227 None] Deleting offline snapshot 72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78 of volume 2c66216f-b29c-46dc-858f-7d229c9f3d73 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:28:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e1fe8460-b4d4-472e-ba29-2e70470bf5ac tempest-ProjectMemberTests-1744160227 None] snapshot_file for this snap is: volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:28:33 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eca233b-e5e9-4cdb-9b2f-4e3dc173bbb8]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e1fe8460-b4d4-472e-ba29-2e70470bf5ac tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:33 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78 Jul 03 01:28:33 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:34 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e1fe8460-b4d4-472e-ba29-2e70470bf5ac tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78" returned: 0 in 0.760s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-e1fe8460-b4d4-472e-ba29-2e70470bf5ac tempest-ProjectMemberTests-1744160227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c66216f-b29c-46dc-858f-7d229c9f3d73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:28:34 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a321ed9a-e6db-4556-8378-98167f2e40fb]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e1fe8460-b4d4-472e-ba29-2e70470bf5ac tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:34 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73 Jul 03 01:28:34 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:35 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e1fe8460-b4d4-472e-ba29-2e70470bf5ac tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73" returned: 0 in 0.750s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e1fe8460-b4d4-472e-ba29-2e70470bf5ac tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:35 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78 Jul 03 01:28:35 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:35 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e1fe8460-b4d4-472e-ba29-2e70470bf5ac tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78" returned: 0 in 0.756s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e1fe8460-b4d4-472e-ba29-2e70470bf5ac tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:35 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78 Jul 03 01:28:35 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:36 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e1fe8460-b4d4-472e-ba29-2e70470bf5ac tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73.72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78" returned: 0 in 0.665s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e1fe8460-b4d4-472e-ba29-2e70470bf5ac tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78" released by "_delete_snapshot" :: held 3.025s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e1fe8460-b4d4-472e-ba29-2e70470bf5ac tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-2c66216f-b29c-46dc-858f-7d229c9f3d73" released by "delete_snapshot" :: held 3.048s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:36 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e1fe8460-b4d4-472e-ba29-2e70470bf5ac tempest-ProjectMemberTests-1744160227 None] Created reservations ['04489da7-6181-41e8-b10c-eaf362715e91', 'aa97201a-c391-47e1-9512-fab0cac3a2ca', 'f66233d2-d7c5-4374-80ea-a15c5a96ee09', '3af3988e-38bf-4664-a442-657528efa727'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:36 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e1fe8460-b4d4-472e-ba29-2e70470bf5ac tempest-ProjectMemberTests-1744160227 None] Delete snapshot completed successfully. Jul 03 01:28:36 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e1fe8460-b4d4-472e-ba29-2e70470bf5ac tempest-ProjectMemberTests-1744160227 None] Lock "cinder-72aa7c00-d7a5-4a59-9b2f-fb8f2c84ae78-delete_snapshot" released by "delete_snapshot" :: held 3.188s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-82448e0c-eb6a-41b8-9ed6-69243e49d5f4 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-2c66216f-b29c-46dc-858f-7d229c9f3d73-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-82448e0c-eb6a-41b8-9ed6-69243e49d5f4 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-2c66216f-b29c-46dc-858f-7d229c9f3d73-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-82448e0c-eb6a-41b8-9ed6-69243e49d5f4 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-2c66216f-b29c-46dc-858f-7d229c9f3d73" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-82448e0c-eb6a-41b8-9ed6-69243e49d5f4 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-2c66216f-b29c-46dc-858f-7d229c9f3d73" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:37 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9768fb59-3843-448a-ba89-11f449d76281]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-82448e0c-eb6a-41b8-9ed6-69243e49d5f4 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:37 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73 Jul 03 01:28:37 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:38 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-82448e0c-eb6a-41b8-9ed6-69243e49d5f4 tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73" returned: 0 in 0.786s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-82448e0c-eb6a-41b8-9ed6-69243e49d5f4 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:38 devstack sudo[108450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73 Jul 03 01:28:38 devstack sudo[108450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:39 devstack sudo[108450]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-82448e0c-eb6a-41b8-9ed6-69243e49d5f4 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-2c66216f-b29c-46dc-858f-7d229c9f3d73" returned: 0 in 0.677s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-82448e0c-eb6a-41b8-9ed6-69243e49d5f4 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-2c66216f-b29c-46dc-858f-7d229c9f3d73" released by "delete_volume" :: held 1.521s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:39 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-82448e0c-eb6a-41b8-9ed6-69243e49d5f4 tempest-ProjectMemberTests-1744160227 None] Created reservations ['6e500440-fd4d-4998-8dbc-f426b1503c6e', '8a215753-b467-4877-84e7-ed5b432866db', 'fe2fa009-06a5-4fb5-a1a7-9202ef3a7d6c', 'b6e64837-ddd2-454a-8417-78b224477f1a'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:28:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-82448e0c-eb6a-41b8-9ed6-69243e49d5f4 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-82448e0c-eb6a-41b8-9ed6-69243e49d5f4 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-82448e0c-eb6a-41b8-9ed6-69243e49d5f4 tempest-ProjectMemberTests-1744160227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-82448e0c-eb6a-41b8-9ed6-69243e49d5f4 tempest-ProjectMemberTests-1744160227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-82448e0c-eb6a-41b8-9ed6-69243e49d5f4 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-82448e0c-eb6a-41b8-9ed6-69243e49d5f4 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:39 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:28:39 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:40 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-82448e0c-eb6a-41b8-9ed6-69243e49d5f4 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.666s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:40 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-82448e0c-eb6a-41b8-9ed6-69243e49d5f4 tempest-ProjectMemberTests-1744160227 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:28:40 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-82448e0c-eb6a-41b8-9ed6-69243e49d5f4 tempest-ProjectMemberTests-1744160227 None] Deleted volume successfully. Jul 03 01:28:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-82448e0c-eb6a-41b8-9ed6-69243e49d5f4 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-2c66216f-b29c-46dc-858f-7d229c9f3d73-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:40 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:28:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Flow 'volume_create_manager' (c8a01e6f-8488-496d-9d69-2b66dd4ffdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e7cdf6-bfe6-45b9-a59b-87275b3c1074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e7cdf6-bfe6-45b9-a59b-87275b3c1074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1702939123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf2c1c96-a821-4a20-83e3-e5e5cb1f227d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970504d68ec94910bf67dae1490927d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:40Z,use_quota=True,user_id='bc9ce9ff10bf4b2cada6d0ec88b24ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2926b87b-8871-438e-96d5-55547a76ff95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2926b87b-8871-438e-96d5-55547a76ff95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e823fe25-4faa-4007-a9f2-f51a70acbd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e823fe25-4faa-4007-a9f2-f51a70acbd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf2c1c96-a821-4a20-83e3-e5e5cb1f227d', 'volume_name': 'volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2783f33e-20ca-4311-bb70-490618bd25b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2783f33e-20ca-4311-bb70-490618bd25b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31ae05e-3466-454e-9adb-f45fb27a8e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:40 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Volume cf2c1c96-a821-4a20-83e3-e5e5cb1f227d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d', 'volume_size': 1} Jul 03 01:28:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1702939123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf2c1c96-a821-4a20-83e3-e5e5cb1f227d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970504d68ec94910bf67dae1490927d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:28:40Z,use_quota=True,user_id='bc9ce9ff10bf4b2cada6d0ec88b24ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:28:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Creating volume cf2c1c96-a821-4a20-83e3-e5e5cb1f227d {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:28:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:28:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:28:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:28:40 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:28:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:40 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d 1073741824 Jul 03 01:28:40 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:41 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d 1073741824" returned: 0 in 0.829s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:41 devstack sudo[108461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d Jul 03 01:28:41 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:42 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d" returned: 0 in 0.666s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:28:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31ae05e-3466-454e-9adb-f45fb27a8e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac5ae3c1-5a70-4397-af74-626bb8cf1509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:28:42 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Volume volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d (cf2c1c96-a821-4a20-83e3-e5e5cb1f227d): created successfully Jul 03 01:28:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac5ae3c1-5a70-4397-af74-626bb8cf1509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:28:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Flow 'volume_create_manager' (c8a01e6f-8488-496d-9d69-2b66dd4ffdfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:28:42 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7b6fe56c-2a6e-404d-841f-dbcffc724df2 tempest-ProjectMemberTests-1744160227 None] Created volume successfully. Jul 03 01:28:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-649a167f-82e8-4817-b9ff-cc4779b06f7e tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:28:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-649a167f-82e8-4817-b9ff-cc4779b06f7e tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:28:42 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-649a167f-82e8-4817-b9ff-cc4779b06f7e tempest-ProjectMemberTests-1744160227 None] Creating offline snapshot 07698ee3-ef83-4fd6-b328-bd94dad046d3 of volume cf2c1c96-a821-4a20-83e3-e5e5cb1f227d {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:28:42 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83d3d29-b91d-4f17-b1cc-456cf8cd7ce3]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:28:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-649a167f-82e8-4817-b9ff-cc4779b06f7e tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:42 devstack sudo[108465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d Jul 03 01:28:42 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:43 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-649a167f-82e8-4817-b9ff-cc4779b06f7e tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d" returned: 0 in 0.776s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-649a167f-82e8-4817-b9ff-cc4779b06f7e tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d.07698ee3-ef83-4fd6-b328-bd94dad046d3 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:43 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d.07698ee3-ef83-4fd6-b328-bd94dad046d3 1G Jul 03 01:28:43 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:44 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-649a167f-82e8-4817-b9ff-cc4779b06f7e tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d.07698ee3-ef83-4fd6-b328-bd94dad046d3 1G" returned: 0 in 0.774s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-649a167f-82e8-4817-b9ff-cc4779b06f7e tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d.07698ee3-ef83-4fd6-b328-bd94dad046d3 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:44 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d.07698ee3-ef83-4fd6-b328-bd94dad046d3 Jul 03 01:28:44 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:44 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-649a167f-82e8-4817-b9ff-cc4779b06f7e tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d.07698ee3-ef83-4fd6-b328-bd94dad046d3" returned: 0 in 0.699s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:44 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-649a167f-82e8-4817-b9ff-cc4779b06f7e tempest-ProjectMemberTests-1744160227 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d.07698ee3-ef83-4fd6-b328-bd94dad046d3 is being set with open permissions: ugo+rw Jul 03 01:28:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-649a167f-82e8-4817-b9ff-cc4779b06f7e tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d.07698ee3-ef83-4fd6-b328-bd94dad046d3 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:44 devstack sudo[108480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d.07698ee3-ef83-4fd6-b328-bd94dad046d3 Jul 03 01:28:44 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:45 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-649a167f-82e8-4817-b9ff-cc4779b06f7e tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d.07698ee3-ef83-4fd6-b328-bd94dad046d3" returned: 0 in 0.633s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-649a167f-82e8-4817-b9ff-cc4779b06f7e tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:45 devstack sudo[108483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d.info Jul 03 01:28:45 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:46 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-649a167f-82e8-4817-b9ff-cc4779b06f7e tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d.info" returned: 0 in 0.678s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:46 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-649a167f-82e8-4817-b9ff-cc4779b06f7e tempest-ProjectMemberTests-1744160227 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d.info is being set with open permissions: ugo+rw Jul 03 01:28:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-649a167f-82e8-4817-b9ff-cc4779b06f7e tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:28:46 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d.info Jul 03 01:28:46 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:28:46 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Jul 03 01:28:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-649a167f-82e8-4817-b9ff-cc4779b06f7e tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-cf2c1c96-a821-4a20-83e3-e5e5cb1f227d.info" returned: 0 in 0.668s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:28:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-649a167f-82e8-4817-b9ff-cc4779b06f7e tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.312s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:28:46 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-649a167f-82e8-4817-b9ff-cc4779b06f7e tempest-ProjectMemberTests-1744160227 None] Create snapshot completed successfully Jul 03 01:28:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-814f7ea0-8d69-41fb-8fe4-47564a26724c tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-07698ee3-ef83-4fd6-b328-bd94dad046d3-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:28:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-814f7ea0-8d69-41fb-8fe4-47564a26724c tempest-ProjectMemberTests-1744160227 None] Lock "cinder-07698ee3-ef83-4fd6-b328-bd94dad046d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:28:47 devstack cinder-volume[86772]: INFO cinder.message.api [None req-814f7ea0-8d69-41fb-8fe4-47564a26724c tempest-ProjectMemberTests-1744160227 None] Creating message record for request_id = req-814f7ea0-8d69-41fb-8fe4-47564a26724c Jul 03 01:28:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-814f7ea0-8d69-41fb-8fe4-47564a26724c tempest-ProjectMemberTests-1744160227 None] Lock "cinder-07698ee3-ef83-4fd6-b328-bd94dad046d3-delete_snapshot" released by "delete_snapshot" :: held 0.037s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server [None req-814f7ea0-8d69-41fb-8fe4-47564a26724c tempest-ProjectMemberTests-1744160227 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server raise self.value Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 03 01:28:47 devstack cinder-volume[86772]: ERROR oslo_messaging.rpc.server Jul 03 01:28:56 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=63,cinder:SELECT=43,cinder:DELETE=8,cinder:INSERT=20 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:28:57 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=59,cinder:UPDATE=70,cinder:INSERT=17,cinder:DELETE=5 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:29:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:29:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:29:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:29:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:29:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:29:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:29:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:29:12 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:29:12 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:29:13 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Jul 03 01:29:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.659s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:29:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:29:13 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:29:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 29 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:29:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:30:07 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:30:07 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:30:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:30:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:30:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:30:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:30:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:30:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:30:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:30:12 devstack sudo[108555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:30:12 devstack sudo[108555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:30:13 devstack sudo[108555]: pam_unix(sudo:session): session closed for user root Jul 03 01:30:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.635s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:30:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:30:13 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:30:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 29 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:30:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:31:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:31:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:31:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:31:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:31:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:31:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:31:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:31:12 devstack sudo[108609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:31:12 devstack sudo[108609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:31:13 devstack sudo[108609]: pam_unix(sudo:session): session closed for user root Jul 03 01:31:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.670s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:31:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:31:13 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:31:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 29 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:31:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Flow 'volume_create_manager' (ca5a1a7f-02f2-466e-8ad6-92d6acc37267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2709e8e4-45e9-469a-9024-47e04a78a05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2709e8e4-45e9-469a-9024-47e04a78a05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2127135012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d3c1ac-2a51-4656-b44d-524b4afab19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8828238dac7841569496db0e0bedd353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:31:42Z,use_quota=True,user_id='e94cf2fe7835400280046d098ea56eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c11f0a66-4a26-43a6-af04-b44e84003505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c11f0a66-4a26-43a6-af04-b44e84003505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c74529-dc59-4e11-a174-b7c93539dde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c74529-dc59-4e11-a174-b7c93539dde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11d3c1ac-2a51-4656-b44d-524b4afab19c', 'volume_name': 'volume-11d3c1ac-2a51-4656-b44d-524b4afab19c', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc160b7-e8bd-47a2-9262-c1f45ef0f13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc160b7-e8bd-47a2-9262-c1f45ef0f13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6edb0f20-f8a8-49ac-a374-4f6d974a5ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:31:41 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Volume 11d3c1ac-2a51-4656-b44d-524b4afab19c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11d3c1ac-2a51-4656-b44d-524b4afab19c', 'volume_size': 1} Jul 03 01:31:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:31:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2127135012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d3c1ac-2a51-4656-b44d-524b4afab19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8828238dac7841569496db0e0bedd353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:31:42Z,use_quota=True,user_id='e94cf2fe7835400280046d098ea56eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Creating volume 11d3c1ac-2a51-4656-b44d-524b4afab19c {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:31:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:31:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:31:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:31:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:31:41 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:31:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:31:41 devstack sudo[108659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c 1073741824 Jul 03 01:31:41 devstack sudo[108659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:31:42 devstack sudo[108659]: pam_unix(sudo:session): session closed for user root Jul 03 01:31:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c 1073741824" returned: 0 in 0.817s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:31:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:31:42 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c Jul 03 01:31:42 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:31:43 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Jul 03 01:31:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c" returned: 0 in 0.646s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:31:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:31:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:31:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6edb0f20-f8a8-49ac-a374-4f6d974a5ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11d3c1ac-2a51-4656-b44d-524b4afab19c', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:31:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (746f47c3-dc2d-4583-a831-8108cc4237eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:31:43 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Volume volume-11d3c1ac-2a51-4656-b44d-524b4afab19c (11d3c1ac-2a51-4656-b44d-524b4afab19c): created successfully Jul 03 01:31:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (746f47c3-dc2d-4583-a831-8108cc4237eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:31:43 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Flow 'volume_create_manager' (ca5a1a7f-02f2-466e-8ad6-92d6acc37267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:31:43 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-09f255e0-d302-490f-b6d2-d23fe0882d46 tempest-ProjectReaderTests-1434632810 None] Created volume successfully. Jul 03 01:31:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f8b15505-c107-4f77-8e37-7850f20f4ccc tempest-ProjectReaderTests-1434632810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:31:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f8b15505-c107-4f77-8e37-7850f20f4ccc tempest-ProjectReaderTests-1434632810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:31:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f8b15505-c107-4f77-8e37-7850f20f4ccc tempest-ProjectReaderTests-1434632810 None] Creating offline snapshot 7c49412c-6e41-4862-a10b-2600d65400f4 of volume 11d3c1ac-2a51-4656-b44d-524b4afab19c {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:31:44 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[467deae4-31ae-4be6-9ff1-8e4206f2067c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:31:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8b15505-c107-4f77-8e37-7850f20f4ccc tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:31:44 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c Jul 03 01:31:44 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:31:44 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Jul 03 01:31:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8b15505-c107-4f77-8e37-7850f20f4ccc tempest-ProjectReaderTests-1434632810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c" returned: 0 in 0.768s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:31:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8b15505-c107-4f77-8e37-7850f20f4ccc tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.7c49412c-6e41-4862-a10b-2600d65400f4 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:31:44 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.7c49412c-6e41-4862-a10b-2600d65400f4 1G Jul 03 01:31:44 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:31:45 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Jul 03 01:31:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8b15505-c107-4f77-8e37-7850f20f4ccc tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.7c49412c-6e41-4862-a10b-2600d65400f4 1G" returned: 0 in 0.797s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:31:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8b15505-c107-4f77-8e37-7850f20f4ccc tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d3c1ac-2a51-4656-b44d-524b4afab19c -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.7c49412c-6e41-4862-a10b-2600d65400f4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:31:45 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d3c1ac-2a51-4656-b44d-524b4afab19c -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.7c49412c-6e41-4862-a10b-2600d65400f4 Jul 03 01:31:45 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:31:46 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Jul 03 01:31:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8b15505-c107-4f77-8e37-7850f20f4ccc tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d3c1ac-2a51-4656-b44d-524b4afab19c -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.7c49412c-6e41-4862-a10b-2600d65400f4" returned: 0 in 0.687s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:31:46 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-f8b15505-c107-4f77-8e37-7850f20f4ccc tempest-ProjectReaderTests-1434632810 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.7c49412c-6e41-4862-a10b-2600d65400f4 is being set with open permissions: ugo+rw Jul 03 01:31:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8b15505-c107-4f77-8e37-7850f20f4ccc tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.7c49412c-6e41-4862-a10b-2600d65400f4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:31:46 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.7c49412c-6e41-4862-a10b-2600d65400f4 Jul 03 01:31:46 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:31:46 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Jul 03 01:31:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8b15505-c107-4f77-8e37-7850f20f4ccc tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.7c49412c-6e41-4862-a10b-2600d65400f4" returned: 0 in 0.658s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:31:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8b15505-c107-4f77-8e37-7850f20f4ccc tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:31:47 devstack sudo[108688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.info Jul 03 01:31:47 devstack sudo[108688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:31:47 devstack sudo[108688]: pam_unix(sudo:session): session closed for user root Jul 03 01:31:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8b15505-c107-4f77-8e37-7850f20f4ccc tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.info" returned: 0 in 0.635s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:31:47 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-f8b15505-c107-4f77-8e37-7850f20f4ccc tempest-ProjectReaderTests-1434632810 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.info is being set with open permissions: ugo+rw Jul 03 01:31:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8b15505-c107-4f77-8e37-7850f20f4ccc tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:31:47 devstack sudo[108691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.info Jul 03 01:31:47 devstack sudo[108691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:31:48 devstack sudo[108691]: pam_unix(sudo:session): session closed for user root Jul 03 01:31:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f8b15505-c107-4f77-8e37-7850f20f4ccc tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.info" returned: 0 in 0.623s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:31:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f8b15505-c107-4f77-8e37-7850f20f4ccc tempest-ProjectReaderTests-1434632810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.253s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:31:48 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f8b15505-c107-4f77-8e37-7850f20f4ccc tempest-ProjectReaderTests-1434632810 None] Create snapshot completed successfully Jul 03 01:31:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-50282cae-f0c2-45c1-b610-997e23cc9059 tempest-ProjectReaderTests-1434632810 None] Acquiring lock "cinder-7c49412c-6e41-4862-a10b-2600d65400f4-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:31:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-50282cae-f0c2-45c1-b610-997e23cc9059 tempest-ProjectReaderTests-1434632810 None] Lock "cinder-7c49412c-6e41-4862-a10b-2600d65400f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:31:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-50282cae-f0c2-45c1-b610-997e23cc9059 tempest-ProjectReaderTests-1434632810 None] Acquiring lock "cinder-quobyte-11d3c1ac-2a51-4656-b44d-524b4afab19c" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:31:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-50282cae-f0c2-45c1-b610-997e23cc9059 tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-11d3c1ac-2a51-4656-b44d-524b4afab19c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:31:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-50282cae-f0c2-45c1-b610-997e23cc9059 tempest-ProjectReaderTests-1434632810 None] Acquiring lock "cinder-quobyte-7c49412c-6e41-4862-a10b-2600d65400f4" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:31:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-50282cae-f0c2-45c1-b610-997e23cc9059 tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-7c49412c-6e41-4862-a10b-2600d65400f4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:31:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-50282cae-f0c2-45c1-b610-997e23cc9059 tempest-ProjectReaderTests-1434632810 None] Deleting offline snapshot 7c49412c-6e41-4862-a10b-2600d65400f4 of volume 11d3c1ac-2a51-4656-b44d-524b4afab19c {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:31:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-50282cae-f0c2-45c1-b610-997e23cc9059 tempest-ProjectReaderTests-1434632810 None] snapshot_file for this snap is: volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.7c49412c-6e41-4862-a10b-2600d65400f4 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:31:49 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7017479-bb16-46b9-b127-993e4e03325b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:31:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50282cae-f0c2-45c1-b610-997e23cc9059 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.7c49412c-6e41-4862-a10b-2600d65400f4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:31:49 devstack sudo[108694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.7c49412c-6e41-4862-a10b-2600d65400f4 Jul 03 01:31:49 devstack sudo[108694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:31:50 devstack sudo[108694]: pam_unix(sudo:session): session closed for user root Jul 03 01:31:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50282cae-f0c2-45c1-b610-997e23cc9059 tempest-ProjectReaderTests-1434632810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.7c49412c-6e41-4862-a10b-2600d65400f4" returned: 0 in 0.747s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:31:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-50282cae-f0c2-45c1-b610-997e23cc9059 tempest-ProjectReaderTests-1434632810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11d3c1ac-2a51-4656-b44d-524b4afab19c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:31:50 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64814aa-abbc-4d51-81e7-417e2ef220cf]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:31:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50282cae-f0c2-45c1-b610-997e23cc9059 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:31:50 devstack sudo[108699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c Jul 03 01:31:50 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:31:50 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root Jul 03 01:31:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50282cae-f0c2-45c1-b610-997e23cc9059 tempest-ProjectReaderTests-1434632810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c" returned: 0 in 0.736s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:31:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50282cae-f0c2-45c1-b610-997e23cc9059 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.7c49412c-6e41-4862-a10b-2600d65400f4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:31:50 devstack sudo[108704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.7c49412c-6e41-4862-a10b-2600d65400f4 Jul 03 01:31:50 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:31:51 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root Jul 03 01:31:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50282cae-f0c2-45c1-b610-997e23cc9059 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.7c49412c-6e41-4862-a10b-2600d65400f4" returned: 0 in 0.697s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:31:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50282cae-f0c2-45c1-b610-997e23cc9059 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.7c49412c-6e41-4862-a10b-2600d65400f4 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:31:51 devstack sudo[108709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.7c49412c-6e41-4862-a10b-2600d65400f4 Jul 03 01:31:51 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:31:52 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root Jul 03 01:31:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-50282cae-f0c2-45c1-b610-997e23cc9059 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c.7c49412c-6e41-4862-a10b-2600d65400f4" returned: 0 in 0.668s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:31:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-50282cae-f0c2-45c1-b610-997e23cc9059 tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-7c49412c-6e41-4862-a10b-2600d65400f4" released by "_delete_snapshot" :: held 2.933s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:31:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-50282cae-f0c2-45c1-b610-997e23cc9059 tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-11d3c1ac-2a51-4656-b44d-524b4afab19c" released by "delete_snapshot" :: held 2.957s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:31:52 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-50282cae-f0c2-45c1-b610-997e23cc9059 tempest-ProjectReaderTests-1434632810 None] Created reservations ['20ee2004-cde0-4d21-99fb-3533a6dc24c2', '77e2a7f6-234e-4208-87d5-407d0c9e1212', 'f014f102-6d0c-4e5e-a5d7-c21a82f552d8', 'c29c82ef-43aa-4635-a27d-96687a8beeb8'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:31:52 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-50282cae-f0c2-45c1-b610-997e23cc9059 tempest-ProjectReaderTests-1434632810 None] Delete snapshot completed successfully. Jul 03 01:31:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-50282cae-f0c2-45c1-b610-997e23cc9059 tempest-ProjectReaderTests-1434632810 None] Lock "cinder-7c49412c-6e41-4862-a10b-2600d65400f4-delete_snapshot" released by "delete_snapshot" :: held 3.092s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:31:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e76efc26-7784-4760-a23f-ec266ab2426d tempest-ProjectReaderTests-1434632810 None] Acquiring lock "cinder-11d3c1ac-2a51-4656-b44d-524b4afab19c-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:31:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e76efc26-7784-4760-a23f-ec266ab2426d tempest-ProjectReaderTests-1434632810 None] Lock "cinder-11d3c1ac-2a51-4656-b44d-524b4afab19c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:31:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e76efc26-7784-4760-a23f-ec266ab2426d tempest-ProjectReaderTests-1434632810 None] Acquiring lock "cinder-quobyte-11d3c1ac-2a51-4656-b44d-524b4afab19c" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:31:52 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e76efc26-7784-4760-a23f-ec266ab2426d tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-11d3c1ac-2a51-4656-b44d-524b4afab19c" acquired by "delete_volume" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:31:52 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59a23bd-e51a-4c2c-bb2a-d83f582061fa]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:31:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e76efc26-7784-4760-a23f-ec266ab2426d tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:31:52 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c Jul 03 01:31:52 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:31:53 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Jul 03 01:31:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e76efc26-7784-4760-a23f-ec266ab2426d tempest-ProjectReaderTests-1434632810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c" returned: 0 in 0.757s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:31:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e76efc26-7784-4760-a23f-ec266ab2426d tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:31:53 devstack sudo[108718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c Jul 03 01:31:53 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:31:53 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root Jul 03 01:31:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e76efc26-7784-4760-a23f-ec266ab2426d tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-11d3c1ac-2a51-4656-b44d-524b4afab19c" returned: 0 in 0.669s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:31:53 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e76efc26-7784-4760-a23f-ec266ab2426d tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-11d3c1ac-2a51-4656-b44d-524b4afab19c" released by "delete_volume" :: held 1.484s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:31:54 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e76efc26-7784-4760-a23f-ec266ab2426d tempest-ProjectReaderTests-1434632810 None] Created reservations ['1325bada-08f4-4b3b-a518-712e868d191b', '360ab84c-8e3f-4d30-95f4-cf89d4e92954', '3b6d85b5-ab64-420d-bc25-7ab5b77a31d2', '6dbbd2c8-8993-4e3a-b811-e6429c684d32'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:31:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e76efc26-7784-4760-a23f-ec266ab2426d tempest-ProjectReaderTests-1434632810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:31:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e76efc26-7784-4760-a23f-ec266ab2426d tempest-ProjectReaderTests-1434632810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:31:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e76efc26-7784-4760-a23f-ec266ab2426d tempest-ProjectReaderTests-1434632810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:31:54 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e76efc26-7784-4760-a23f-ec266ab2426d tempest-ProjectReaderTests-1434632810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:31:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e76efc26-7784-4760-a23f-ec266ab2426d tempest-ProjectReaderTests-1434632810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:31:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e76efc26-7784-4760-a23f-ec266ab2426d tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:31:54 devstack sudo[108721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:31:54 devstack sudo[108721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:31:54 devstack sudo[108721]: pam_unix(sudo:session): session closed for user root Jul 03 01:31:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e76efc26-7784-4760-a23f-ec266ab2426d tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.672s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:31:54 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-e76efc26-7784-4760-a23f-ec266ab2426d tempest-ProjectReaderTests-1434632810 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:31:54 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e76efc26-7784-4760-a23f-ec266ab2426d tempest-ProjectReaderTests-1434632810 None] Deleted volume successfully. Jul 03 01:31:54 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e76efc26-7784-4760-a23f-ec266ab2426d tempest-ProjectReaderTests-1434632810 None] Lock "cinder-11d3c1ac-2a51-4656-b44d-524b4afab19c-delete_volume" released by "delete_volume" :: held 2.345s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:31:55 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:31:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Flow 'volume_create_manager' (de4346e4-071a-4104-8cf0-1c96bd79daff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:31:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5befa9-814c-4e30-bf85-f52d71e91044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:31:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5befa9-814c-4e30-bf85-f52d71e91044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-794935618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a89bb0c-1046-4e50-b305-2b4f50a31057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8828238dac7841569496db0e0bedd353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:31:55Z,use_quota=True,user_id='e94cf2fe7835400280046d098ea56eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:31:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dfd27b4-f043-4e9d-9954-8fb5c85a88a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:31:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dfd27b4-f043-4e9d-9954-8fb5c85a88a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:31:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eed9677-6645-4d6f-a034-1c8bffc4b596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:31:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eed9677-6645-4d6f-a034-1c8bffc4b596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a89bb0c-1046-4e50-b305-2b4f50a31057', 'volume_name': 'volume-6a89bb0c-1046-4e50-b305-2b4f50a31057', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:31:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (254612bb-8a6c-48ec-81fc-d3b24393abe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:31:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (254612bb-8a6c-48ec-81fc-d3b24393abe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:31:55 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ee3f53-2f77-479e-86d9-678e8a6b2664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:31:55 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Volume 6a89bb0c-1046-4e50-b305-2b4f50a31057: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a89bb0c-1046-4e50-b305-2b4f50a31057', 'volume_size': 1} Jul 03 01:31:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:31:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:31:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-794935618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a89bb0c-1046-4e50-b305-2b4f50a31057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8828238dac7841569496db0e0bedd353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:31:55Z,use_quota=True,user_id='e94cf2fe7835400280046d098ea56eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:31:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Creating volume 6a89bb0c-1046-4e50-b305-2b4f50a31057 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:31:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:31:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:31:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:31:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:31:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:31:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:31:55 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:31:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:31:55 devstack sudo[108724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057 1073741824 Jul 03 01:31:55 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:31:55 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root Jul 03 01:31:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057 1073741824" returned: 0 in 0.816s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:31:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:31:56 devstack sudo[108729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057 Jul 03 01:31:56 devstack sudo[108729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:31:56 devstack sudo[108729]: pam_unix(sudo:session): session closed for user root Jul 03 01:31:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057" returned: 0 in 0.633s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:31:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:31:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:31:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ee3f53-2f77-479e-86d9-678e8a6b2664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a89bb0c-1046-4e50-b305-2b4f50a31057', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:31:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3abb404-e0f2-499a-9e03-182b18a4482a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:31:56 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Volume volume-6a89bb0c-1046-4e50-b305-2b4f50a31057 (6a89bb0c-1046-4e50-b305-2b4f50a31057): created successfully Jul 03 01:31:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3abb404-e0f2-499a-9e03-182b18a4482a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:31:56 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Flow 'volume_create_manager' (de4346e4-071a-4104-8cf0-1c96bd79daff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:31:56 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-bd55b23a-b8ab-4835-92fe-c8ac558518a1 tempest-ProjectReaderTests-1434632810 None] Created volume successfully. Jul 03 01:31:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b5b2eeff-bf11-4bef-b757-6f730cfc75a3 tempest-ProjectReaderTests-1434632810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:31:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b5b2eeff-bf11-4bef-b757-6f730cfc75a3 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:31:57 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-b5b2eeff-bf11-4bef-b757-6f730cfc75a3 tempest-ProjectReaderTests-1434632810 None] Creating offline snapshot 4d70f127-ba9d-4696-8434-71987e965e6a of volume 6a89bb0c-1046-4e50-b305-2b4f50a31057 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:31:57 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b51cf4-c943-4a8e-b7b4-b08f50ff0855]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:31:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b5b2eeff-bf11-4bef-b757-6f730cfc75a3 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:31:57 devstack sudo[108732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057 Jul 03 01:31:57 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:31:58 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root Jul 03 01:31:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b5b2eeff-bf11-4bef-b757-6f730cfc75a3 tempest-ProjectReaderTests-1434632810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057" returned: 0 in 0.753s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:31:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b5b2eeff-bf11-4bef-b757-6f730cfc75a3 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.4d70f127-ba9d-4696-8434-71987e965e6a 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:31:58 devstack sudo[108737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.4d70f127-ba9d-4696-8434-71987e965e6a 1G Jul 03 01:31:58 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:31:58 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root Jul 03 01:31:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b5b2eeff-bf11-4bef-b757-6f730cfc75a3 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.4d70f127-ba9d-4696-8434-71987e965e6a 1G" returned: 0 in 0.780s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:31:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b5b2eeff-bf11-4bef-b757-6f730cfc75a3 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a89bb0c-1046-4e50-b305-2b4f50a31057 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.4d70f127-ba9d-4696-8434-71987e965e6a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:31:58 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a89bb0c-1046-4e50-b305-2b4f50a31057 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.4d70f127-ba9d-4696-8434-71987e965e6a Jul 03 01:31:58 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:31:59 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Jul 03 01:31:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b5b2eeff-bf11-4bef-b757-6f730cfc75a3 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a89bb0c-1046-4e50-b305-2b4f50a31057 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.4d70f127-ba9d-4696-8434-71987e965e6a" returned: 0 in 0.692s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:31:59 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-b5b2eeff-bf11-4bef-b757-6f730cfc75a3 tempest-ProjectReaderTests-1434632810 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.4d70f127-ba9d-4696-8434-71987e965e6a is being set with open permissions: ugo+rw Jul 03 01:31:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b5b2eeff-bf11-4bef-b757-6f730cfc75a3 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.4d70f127-ba9d-4696-8434-71987e965e6a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:31:59 devstack sudo[108747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.4d70f127-ba9d-4696-8434-71987e965e6a Jul 03 01:31:59 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:00 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b5b2eeff-bf11-4bef-b757-6f730cfc75a3 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.4d70f127-ba9d-4696-8434-71987e965e6a" returned: 0 in 0.632s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b5b2eeff-bf11-4bef-b757-6f730cfc75a3 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:00 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.info Jul 03 01:32:00 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:00 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b5b2eeff-bf11-4bef-b757-6f730cfc75a3 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.info" returned: 0 in 0.640s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:00 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-b5b2eeff-bf11-4bef-b757-6f730cfc75a3 tempest-ProjectReaderTests-1434632810 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.info is being set with open permissions: ugo+rw Jul 03 01:32:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b5b2eeff-bf11-4bef-b757-6f730cfc75a3 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:00 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.info Jul 03 01:32:00 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:01 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b5b2eeff-bf11-4bef-b757-6f730cfc75a3 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.info" returned: 0 in 0.647s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b5b2eeff-bf11-4bef-b757-6f730cfc75a3 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.230s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:01 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b5b2eeff-bf11-4bef-b757-6f730cfc75a3 tempest-ProjectReaderTests-1434632810 None] Create snapshot completed successfully Jul 03 01:32:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3f83247f-6707-4fbf-953a-bdb00aef3b68 tempest-ProjectReaderTests-1434632810 None] Acquiring lock "cinder-4d70f127-ba9d-4696-8434-71987e965e6a-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3f83247f-6707-4fbf-953a-bdb00aef3b68 tempest-ProjectReaderTests-1434632810 None] Lock "cinder-4d70f127-ba9d-4696-8434-71987e965e6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3f83247f-6707-4fbf-953a-bdb00aef3b68 tempest-ProjectReaderTests-1434632810 None] Acquiring lock "cinder-quobyte-6a89bb0c-1046-4e50-b305-2b4f50a31057" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3f83247f-6707-4fbf-953a-bdb00aef3b68 tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-6a89bb0c-1046-4e50-b305-2b4f50a31057" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3f83247f-6707-4fbf-953a-bdb00aef3b68 tempest-ProjectReaderTests-1434632810 None] Acquiring lock "cinder-quobyte-4d70f127-ba9d-4696-8434-71987e965e6a" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:02 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3f83247f-6707-4fbf-953a-bdb00aef3b68 tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-4d70f127-ba9d-4696-8434-71987e965e6a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3f83247f-6707-4fbf-953a-bdb00aef3b68 tempest-ProjectReaderTests-1434632810 None] Deleting offline snapshot 4d70f127-ba9d-4696-8434-71987e965e6a of volume 6a89bb0c-1046-4e50-b305-2b4f50a31057 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:32:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3f83247f-6707-4fbf-953a-bdb00aef3b68 tempest-ProjectReaderTests-1434632810 None] snapshot_file for this snap is: volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.4d70f127-ba9d-4696-8434-71987e965e6a {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:32:02 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d66528-b21e-428e-b493-7aed1e285f41]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3f83247f-6707-4fbf-953a-bdb00aef3b68 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.4d70f127-ba9d-4696-8434-71987e965e6a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:02 devstack sudo[108757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.4d70f127-ba9d-4696-8434-71987e965e6a Jul 03 01:32:02 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:03 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3f83247f-6707-4fbf-953a-bdb00aef3b68 tempest-ProjectReaderTests-1434632810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.4d70f127-ba9d-4696-8434-71987e965e6a" returned: 0 in 0.760s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3f83247f-6707-4fbf-953a-bdb00aef3b68 tempest-ProjectReaderTests-1434632810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a89bb0c-1046-4e50-b305-2b4f50a31057(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:32:03 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a2fe23-9676-4050-aecb-a97000d3ae3d]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3f83247f-6707-4fbf-953a-bdb00aef3b68 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:03 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057 Jul 03 01:32:03 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Flow 'volume_create_manager' (439661cb-68ef-4fc0-9ea8-7db468c3396d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90fbc4f-159b-4e50-b958-8a8a284b7d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90fbc4f-159b-4e50-b958-8a8a284b7d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-527147205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a4e7619-4932-43ac-8c5c-ddf2dabbfb44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970504d68ec94910bf67dae1490927d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:32:04Z,use_quota=True,user_id='bc9ce9ff10bf4b2cada6d0ec88b24ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d465a3-ec52-49af-a99d-a00a0f1350f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d465a3-ec52-49af-a99d-a00a0f1350f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2b6620-8cdb-47e2-a490-37de42cd535a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2b6620-8cdb-47e2-a490-37de42cd535a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a4e7619-4932-43ac-8c5c-ddf2dabbfb44', 'volume_name': 'volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5792bc8-f315-4ec3-bdaf-9af5e0e55361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5792bc8-f315-4ec3-bdaf-9af5e0e55361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c56806-d010-4bac-af84-cc14b769e632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:04 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Volume 7a4e7619-4932-43ac-8c5c-ddf2dabbfb44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44', 'volume_size': 1} Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-527147205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a4e7619-4932-43ac-8c5c-ddf2dabbfb44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970504d68ec94910bf67dae1490927d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:32:04Z,use_quota=True,user_id='bc9ce9ff10bf4b2cada6d0ec88b24ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Creating volume 7a4e7619-4932-43ac-8c5c-ddf2dabbfb44 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:32:04 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:32:04 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3f83247f-6707-4fbf-953a-bdb00aef3b68 tempest-ProjectReaderTests-1434632810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057" returned: 0 in 0.782s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3f83247f-6707-4fbf-953a-bdb00aef3b68 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.4d70f127-ba9d-4696-8434-71987e965e6a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:04 devstack sudo[108768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44 1073741824 Jul 03 01:32:04 devstack sudo[108768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:04 devstack sudo[108769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.4d70f127-ba9d-4696-8434-71987e965e6a Jul 03 01:32:04 devstack sudo[108769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:04 devstack sudo[108769]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3f83247f-6707-4fbf-953a-bdb00aef3b68 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.4d70f127-ba9d-4696-8434-71987e965e6a" returned: 0 in 0.762s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3f83247f-6707-4fbf-953a-bdb00aef3b68 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.4d70f127-ba9d-4696-8434-71987e965e6a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:04 devstack sudo[108779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.4d70f127-ba9d-4696-8434-71987e965e6a Jul 03 01:32:04 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:04 devstack sudo[108768]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44 1073741824" returned: 0 in 0.816s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:05 devstack sudo[108781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44 Jul 03 01:32:05 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:05 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3f83247f-6707-4fbf-953a-bdb00aef3b68 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057.4d70f127-ba9d-4696-8434-71987e965e6a" returned: 0 in 0.643s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3f83247f-6707-4fbf-953a-bdb00aef3b68 tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-4d70f127-ba9d-4696-8434-71987e965e6a" released by "_delete_snapshot" :: held 3.038s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3f83247f-6707-4fbf-953a-bdb00aef3b68 tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-6a89bb0c-1046-4e50-b305-2b4f50a31057" released by "delete_snapshot" :: held 3.062s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:05 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44" returned: 0 in 0.649s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:05 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:32:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c56806-d010-4bac-af84-cc14b769e632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa2f510-2dcf-4306-8a82-749e8505132d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:05 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Volume volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44 (7a4e7619-4932-43ac-8c5c-ddf2dabbfb44): created successfully Jul 03 01:32:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa2f510-2dcf-4306-8a82-749e8505132d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:05 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Flow 'volume_create_manager' (439661cb-68ef-4fc0-9ea8-7db468c3396d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:32:05 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-3f83247f-6707-4fbf-953a-bdb00aef3b68 tempest-ProjectReaderTests-1434632810 None] Created reservations ['79f3540f-ccab-4ca1-a66e-c3c8d0916692', '48a173c9-22e1-494a-8cb5-d478aee38afa', 'ee806c42-0109-4eb2-b6f1-d6e0982462b8', '65e81440-f555-4469-ab5f-adc3cb7ccd4c'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:32:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-de8b0346-3570-4ec8-a5ac-b0d57d57567f tempest-ProjectMemberTests-1744160227 None] Created volume successfully. Jul 03 01:32:05 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3f83247f-6707-4fbf-953a-bdb00aef3b68 tempest-ProjectReaderTests-1434632810 None] Delete snapshot completed successfully. Jul 03 01:32:05 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3f83247f-6707-4fbf-953a-bdb00aef3b68 tempest-ProjectReaderTests-1434632810 None] Lock "cinder-4d70f127-ba9d-4696-8434-71987e965e6a-delete_snapshot" released by "delete_snapshot" :: held 3.245s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-065a796c-c422-4bff-be1c-31b12f458abb tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-065a796c-c422-4bff-be1c-31b12f458abb tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:06 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-065a796c-c422-4bff-be1c-31b12f458abb tempest-ProjectMemberTests-1744160227 None] Creating offline snapshot 103d6c2c-09e3-4fab-9bf3-5e56a5fc396f of volume 7a4e7619-4932-43ac-8c5c-ddf2dabbfb44 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:32:06 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be0eaa7-4b44-4a57-b012-c7d13a8dc46c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-065a796c-c422-4bff-be1c-31b12f458abb tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:06 devstack sudo[108785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44 Jul 03 01:32:06 devstack sudo[108785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e51523c3-1c93-4423-83f3-8e5c8f8bc2b1 tempest-ProjectReaderTests-1434632810 None] Acquiring lock "cinder-6a89bb0c-1046-4e50-b305-2b4f50a31057-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e51523c3-1c93-4423-83f3-8e5c8f8bc2b1 tempest-ProjectReaderTests-1434632810 None] Lock "cinder-6a89bb0c-1046-4e50-b305-2b4f50a31057-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e51523c3-1c93-4423-83f3-8e5c8f8bc2b1 tempest-ProjectReaderTests-1434632810 None] Acquiring lock "cinder-quobyte-6a89bb0c-1046-4e50-b305-2b4f50a31057" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:06 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e51523c3-1c93-4423-83f3-8e5c8f8bc2b1 tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-6a89bb0c-1046-4e50-b305-2b4f50a31057" acquired by "delete_volume" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:06 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[112c0dd8-0965-449a-b1e8-db33ad88a164]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e51523c3-1c93-4423-83f3-8e5c8f8bc2b1 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:06 devstack sudo[108787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057 Jul 03 01:32:07 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:07 devstack sudo[108785]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-065a796c-c422-4bff-be1c-31b12f458abb tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44" returned: 0 in 0.776s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-065a796c-c422-4bff-be1c-31b12f458abb tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.103d6c2c-09e3-4fab-9bf3-5e56a5fc396f 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:07 devstack sudo[108792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.103d6c2c-09e3-4fab-9bf3-5e56a5fc396f 1G Jul 03 01:32:07 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:07 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e51523c3-1c93-4423-83f3-8e5c8f8bc2b1 tempest-ProjectReaderTests-1434632810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057" returned: 0 in 0.763s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e51523c3-1c93-4423-83f3-8e5c8f8bc2b1 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:07 devstack sudo[108801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057 Jul 03 01:32:07 devstack sudo[108801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:07 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-065a796c-c422-4bff-be1c-31b12f458abb tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.103d6c2c-09e3-4fab-9bf3-5e56a5fc396f 1G" returned: 0 in 0.850s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-065a796c-c422-4bff-be1c-31b12f458abb tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.103d6c2c-09e3-4fab-9bf3-5e56a5fc396f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:07 devstack sudo[108803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.103d6c2c-09e3-4fab-9bf3-5e56a5fc396f Jul 03 01:32:07 devstack sudo[108803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:08 devstack sudo[108801]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e51523c3-1c93-4423-83f3-8e5c8f8bc2b1 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-6a89bb0c-1046-4e50-b305-2b4f50a31057" returned: 0 in 0.660s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e51523c3-1c93-4423-83f3-8e5c8f8bc2b1 tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-6a89bb0c-1046-4e50-b305-2b4f50a31057" released by "delete_volume" :: held 1.488s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:08 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e51523c3-1c93-4423-83f3-8e5c8f8bc2b1 tempest-ProjectReaderTests-1434632810 None] Created reservations ['9b216f61-49b5-4c8e-a70e-0798d15d8fe1', '0d6b4e39-6a92-4098-bcdc-ac6d6b30c253', '37b4423a-5026-4ddf-8511-81888764017e', '008833d7-233e-499d-a9f2-deddd783109f'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:32:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e51523c3-1c93-4423-83f3-8e5c8f8bc2b1 tempest-ProjectReaderTests-1434632810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e51523c3-1c93-4423-83f3-8e5c8f8bc2b1 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e51523c3-1c93-4423-83f3-8e5c8f8bc2b1 tempest-ProjectReaderTests-1434632810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:32:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e51523c3-1c93-4423-83f3-8e5c8f8bc2b1 tempest-ProjectReaderTests-1434632810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:32:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e51523c3-1c93-4423-83f3-8e5c8f8bc2b1 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e51523c3-1c93-4423-83f3-8e5c8f8bc2b1 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:08 devstack sudo[108806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:32:08 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:08 devstack sudo[108803]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-065a796c-c422-4bff-be1c-31b12f458abb tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.103d6c2c-09e3-4fab-9bf3-5e56a5fc396f" returned: 0 in 0.708s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:08 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-065a796c-c422-4bff-be1c-31b12f458abb tempest-ProjectMemberTests-1744160227 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.103d6c2c-09e3-4fab-9bf3-5e56a5fc396f is being set with open permissions: ugo+rw Jul 03 01:32:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-065a796c-c422-4bff-be1c-31b12f458abb tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.103d6c2c-09e3-4fab-9bf3-5e56a5fc396f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:08 devstack sudo[108811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.103d6c2c-09e3-4fab-9bf3-5e56a5fc396f Jul 03 01:32:08 devstack sudo[108811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:09 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e51523c3-1c93-4423-83f3-8e5c8f8bc2b1 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.664s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:09 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-e51523c3-1c93-4423-83f3-8e5c8f8bc2b1 tempest-ProjectReaderTests-1434632810 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:32:09 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e51523c3-1c93-4423-83f3-8e5c8f8bc2b1 tempest-ProjectReaderTests-1434632810 None] Deleted volume successfully. Jul 03 01:32:09 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e51523c3-1c93-4423-83f3-8e5c8f8bc2b1 tempest-ProjectReaderTests-1434632810 None] Lock "cinder-6a89bb0c-1046-4e50-b305-2b4f50a31057-delete_volume" released by "delete_volume" :: held 2.364s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:09 devstack sudo[108811]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-065a796c-c422-4bff-be1c-31b12f458abb tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.103d6c2c-09e3-4fab-9bf3-5e56a5fc396f" returned: 0 in 0.691s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-065a796c-c422-4bff-be1c-31b12f458abb tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:09 devstack sudo[108815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.info Jul 03 01:32:09 devstack sudo[108815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:09 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:32:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Flow 'volume_create_manager' (3b2c3890-f91f-4f11-a019-7736dc9a63b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:32:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5727a801-509b-48c8-ac82-c73f276d06ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5727a801-509b-48c8-ac82-c73f276d06ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1906478142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99106df9-24cf-44c3-a2ac-9b5af6f2cbf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8828238dac7841569496db0e0bedd353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:32:09Z,use_quota=True,user_id='e94cf2fe7835400280046d098ea56eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f22c5d1b-8da6-4e84-978a-480ee5ec78a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f22c5d1b-8da6-4e84-978a-480ee5ec78a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd874f6d-6a27-41fc-a2df-1280e989bd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd874f6d-6a27-41fc-a2df-1280e989bd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99106df9-24cf-44c3-a2ac-9b5af6f2cbf2', 'volume_name': 'volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ef7cf5-3f26-4d96-8cab-de6570f3586c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ef7cf5-3f26-4d96-8cab-de6570f3586c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:09 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee12dd7-4fdc-41fa-93e1-f888f901809c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:09 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Volume 99106df9-24cf-44c3-a2ac-9b5af6f2cbf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2', 'volume_size': 1} Jul 03 01:32:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:09 devstack sudo[108815]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-065a796c-c422-4bff-be1c-31b12f458abb tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.info" returned: 0 in 0.653s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:09 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-065a796c-c422-4bff-be1c-31b12f458abb tempest-ProjectMemberTests-1744160227 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.info is being set with open permissions: ugo+rw Jul 03 01:32:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-065a796c-c422-4bff-be1c-31b12f458abb tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:10 devstack sudo[108818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.info Jul 03 01:32:10 devstack sudo[108818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:10 devstack sudo[108818]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-065a796c-c422-4bff-be1c-31b12f458abb tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.info" returned: 0 in 0.642s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-065a796c-c422-4bff-be1c-31b12f458abb tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.410s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.115s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1906478142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99106df9-24cf-44c3-a2ac-9b5af6f2cbf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8828238dac7841569496db0e0bedd353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:32:09Z,use_quota=True,user_id='e94cf2fe7835400280046d098ea56eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:32:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Creating volume 99106df9-24cf-44c3-a2ac-9b5af6f2cbf2 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:32:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:32:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:32:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:10 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:32:10 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:32:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:10 devstack sudo[108821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2 1073741824 Jul 03 01:32:10 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:10 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-065a796c-c422-4bff-be1c-31b12f458abb tempest-ProjectMemberTests-1744160227 None] Create snapshot completed successfully Jul 03 01:32:11 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e1b9c00-c73d-44a9-adc7-2427d2ecb672 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-103d6c2c-09e3-4fab-9bf3-5e56a5fc396f-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2 1073741824" returned: 0 in 0.836s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e1b9c00-c73d-44a9-adc7-2427d2ecb672 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-103d6c2c-09e3-4fab-9bf3-5e56a5fc396f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e1b9c00-c73d-44a9-adc7-2427d2ecb672 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e1b9c00-c73d-44a9-adc7-2427d2ecb672 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e1b9c00-c73d-44a9-adc7-2427d2ecb672 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-103d6c2c-09e3-4fab-9bf3-5e56a5fc396f" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e1b9c00-c73d-44a9-adc7-2427d2ecb672 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-103d6c2c-09e3-4fab-9bf3-5e56a5fc396f" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:11 devstack sudo[108827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2 Jul 03 01:32:11 devstack sudo[108827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4e1b9c00-c73d-44a9-adc7-2427d2ecb672 tempest-ProjectMemberTests-1744160227 None] Deleting offline snapshot 103d6c2c-09e3-4fab-9bf3-5e56a5fc396f of volume 7a4e7619-4932-43ac-8c5c-ddf2dabbfb44 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:32:11 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4e1b9c00-c73d-44a9-adc7-2427d2ecb672 tempest-ProjectMemberTests-1744160227 None] snapshot_file for this snap is: volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.103d6c2c-09e3-4fab-9bf3-5e56a5fc396f {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:32:11 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a409fd91-ba96-44b9-a7f8-2d1e4e432289]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e1b9c00-c73d-44a9-adc7-2427d2ecb672 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.103d6c2c-09e3-4fab-9bf3-5e56a5fc396f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:11 devstack sudo[108829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.103d6c2c-09e3-4fab-9bf3-5e56a5fc396f Jul 03 01:32:11 devstack sudo[108829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:12 devstack sudo[108827]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2" returned: 0 in 0.653s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:32:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee12dd7-4fdc-41fa-93e1-f888f901809c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d2d7b6-c6c3-46dd-ab21-55969a058093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:12 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Volume volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2 (99106df9-24cf-44c3-a2ac-9b5af6f2cbf2): created successfully Jul 03 01:32:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d2d7b6-c6c3-46dd-ab21-55969a058093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:12 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Flow 'volume_create_manager' (3b2c3890-f91f-4f11-a019-7736dc9a63b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:32:12 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-136ce5b4-916f-4284-836a-067fe9fb0eca tempest-ProjectReaderTests-1434632810 None] Created volume successfully. Jul 03 01:32:12 devstack sudo[108829]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e1b9c00-c73d-44a9-adc7-2427d2ecb672 tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.103d6c2c-09e3-4fab-9bf3-5e56a5fc396f" returned: 0 in 0.779s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-4e1b9c00-c73d-44a9-adc7-2427d2ecb672 tempest-ProjectMemberTests-1744160227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:32:12 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c1697b-475a-4e56-82d3-60789b13e972]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e1b9c00-c73d-44a9-adc7-2427d2ecb672 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:12 devstack sudo[108836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44 Jul 03 01:32:12 devstack sudo[108836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-04686c64-b9b0-4afb-a835-7e72229835d7 tempest-ProjectReaderTests-1434632810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-04686c64-b9b0-4afb-a835-7e72229835d7 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-04686c64-b9b0-4afb-a835-7e72229835d7 tempest-ProjectReaderTests-1434632810 None] Creating offline snapshot f80b9fe2-a267-4944-af37-17ccd83f0854 of volume 99106df9-24cf-44c3-a2ac-9b5af6f2cbf2 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:32:12 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[60739271-6262-472d-8693-1c42729cb0bd]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-04686c64-b9b0-4afb-a835-7e72229835d7 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:32:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:32:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:32:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:12 devstack sudo[108839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:32:12 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:12 devstack sudo[108838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2 Jul 03 01:32:12 devstack sudo[108838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:13 devstack sudo[108836]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e1b9c00-c73d-44a9-adc7-2427d2ecb672 tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44" returned: 0 in 0.787s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e1b9c00-c73d-44a9-adc7-2427d2ecb672 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.103d6c2c-09e3-4fab-9bf3-5e56a5fc396f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:13 devstack sudo[108845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.103d6c2c-09e3-4fab-9bf3-5e56a5fc396f Jul 03 01:32:13 devstack sudo[108845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:13 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.678s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:32:13 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:32:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 29 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:32:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:32:13 devstack sudo[108838]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-04686c64-b9b0-4afb-a835-7e72229835d7 tempest-ProjectReaderTests-1434632810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2" returned: 0 in 0.775s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-04686c64-b9b0-4afb-a835-7e72229835d7 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.f80b9fe2-a267-4944-af37-17ccd83f0854 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:13 devstack sudo[108853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.f80b9fe2-a267-4944-af37-17ccd83f0854 1G Jul 03 01:32:13 devstack sudo[108853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:13 devstack sudo[108845]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e1b9c00-c73d-44a9-adc7-2427d2ecb672 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.103d6c2c-09e3-4fab-9bf3-5e56a5fc396f" returned: 0 in 0.764s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e1b9c00-c73d-44a9-adc7-2427d2ecb672 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.103d6c2c-09e3-4fab-9bf3-5e56a5fc396f {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:14 devstack sudo[108858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.103d6c2c-09e3-4fab-9bf3-5e56a5fc396f Jul 03 01:32:14 devstack sudo[108858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:14 devstack sudo[108853]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-04686c64-b9b0-4afb-a835-7e72229835d7 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.f80b9fe2-a267-4944-af37-17ccd83f0854 1G" returned: 0 in 0.821s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-04686c64-b9b0-4afb-a835-7e72229835d7 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.f80b9fe2-a267-4944-af37-17ccd83f0854 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:14 devstack sudo[108863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.f80b9fe2-a267-4944-af37-17ccd83f0854 Jul 03 01:32:14 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:14 devstack sudo[108858]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-4e1b9c00-c73d-44a9-adc7-2427d2ecb672 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44.103d6c2c-09e3-4fab-9bf3-5e56a5fc396f" returned: 0 in 0.644s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e1b9c00-c73d-44a9-adc7-2427d2ecb672 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-103d6c2c-09e3-4fab-9bf3-5e56a5fc396f" released by "_delete_snapshot" :: held 3.072s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e1b9c00-c73d-44a9-adc7-2427d2ecb672 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44" released by "delete_snapshot" :: held 3.110s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:14 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-4e1b9c00-c73d-44a9-adc7-2427d2ecb672 tempest-ProjectMemberTests-1744160227 None] Created reservations ['49cad58f-36ff-475c-b7e1-65525dc76242', 'b50dfe63-54f0-4f9e-9fb6-a343a5b0b95e', '846241ed-16ab-4b5e-9a35-347c253d214a', '2a56b1c5-b9b8-4954-8542-9b101ff3837b'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:32:14 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-4e1b9c00-c73d-44a9-adc7-2427d2ecb672 tempest-ProjectMemberTests-1744160227 None] Delete snapshot completed successfully. Jul 03 01:32:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-4e1b9c00-c73d-44a9-adc7-2427d2ecb672 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-103d6c2c-09e3-4fab-9bf3-5e56a5fc396f-delete_snapshot" released by "delete_snapshot" :: held 3.257s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:15 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-04686c64-b9b0-4afb-a835-7e72229835d7 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.f80b9fe2-a267-4944-af37-17ccd83f0854" returned: 0 in 0.674s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:15 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-04686c64-b9b0-4afb-a835-7e72229835d7 tempest-ProjectReaderTests-1434632810 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.f80b9fe2-a267-4944-af37-17ccd83f0854 is being set with open permissions: ugo+rw Jul 03 01:32:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-04686c64-b9b0-4afb-a835-7e72229835d7 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.f80b9fe2-a267-4944-af37-17ccd83f0854 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:15 devstack sudo[108869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.f80b9fe2-a267-4944-af37-17ccd83f0854 Jul 03 01:32:15 devstack sudo[108869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b0add377-53c1-4dea-8fee-977bcef1c285 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b0add377-53c1-4dea-8fee-977bcef1c285 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b0add377-53c1-4dea-8fee-977bcef1c285 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:15 devstack sudo[108869]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-04686c64-b9b0-4afb-a835-7e72229835d7 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.f80b9fe2-a267-4944-af37-17ccd83f0854" returned: 0 in 0.641s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:15 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b0add377-53c1-4dea-8fee-977bcef1c285 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44" acquired by "delete_volume" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-04686c64-b9b0-4afb-a835-7e72229835d7 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:15 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d14bd55-9a32-4760-9979-970aba9d7a66]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:15 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0add377-53c1-4dea-8fee-977bcef1c285 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:15 devstack sudo[108873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.info Jul 03 01:32:15 devstack sudo[108873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:15 devstack sudo[108874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44 Jul 03 01:32:15 devstack sudo[108874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:16 devstack sudo[108873]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-04686c64-b9b0-4afb-a835-7e72229835d7 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.info" returned: 0 in 0.662s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:16 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-04686c64-b9b0-4afb-a835-7e72229835d7 tempest-ProjectReaderTests-1434632810 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.info is being set with open permissions: ugo+rw Jul 03 01:32:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-04686c64-b9b0-4afb-a835-7e72229835d7 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:16 devstack sudo[108880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.info Jul 03 01:32:16 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:16 devstack sudo[108874]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0add377-53c1-4dea-8fee-977bcef1c285 tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44" returned: 0 in 0.780s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:16 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0add377-53c1-4dea-8fee-977bcef1c285 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:16 devstack sudo[108883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44 Jul 03 01:32:16 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:17 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-04686c64-b9b0-4afb-a835-7e72229835d7 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.info" returned: 0 in 0.663s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-04686c64-b9b0-4afb-a835-7e72229835d7 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.359s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:17 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-04686c64-b9b0-4afb-a835-7e72229835d7 tempest-ProjectReaderTests-1434632810 None] Create snapshot completed successfully Jul 03 01:32:17 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0add377-53c1-4dea-8fee-977bcef1c285 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44" returned: 0 in 0.696s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:17 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b0add377-53c1-4dea-8fee-977bcef1c285 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44" released by "delete_volume" :: held 1.550s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:17 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-b0add377-53c1-4dea-8fee-977bcef1c285 tempest-ProjectMemberTests-1744160227 None] Created reservations ['17299808-63c7-41ad-a4c9-2b5c6b2a49b7', '9ef9592f-5dde-4086-a43b-9fe8f0c6505c', 'e8a9817e-c9fa-4a4c-92bc-abdbdf9d240c', '3fc0f6ba-9be3-4c3a-812b-65f268737635'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:32:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b0add377-53c1-4dea-8fee-977bcef1c285 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b0add377-53c1-4dea-8fee-977bcef1c285 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b0add377-53c1-4dea-8fee-977bcef1c285 tempest-ProjectMemberTests-1744160227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:32:17 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-b0add377-53c1-4dea-8fee-977bcef1c285 tempest-ProjectMemberTests-1744160227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:32:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-b0add377-53c1-4dea-8fee-977bcef1c285 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:17 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0add377-53c1-4dea-8fee-977bcef1c285 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:17 devstack sudo[108887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:32:17 devstack sudo[108887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-05a17fa1-d768-4946-8c65-36ebbc0620ee tempest-ProjectReaderTests-1434632810 None] Acquiring lock "cinder-f80b9fe2-a267-4944-af37-17ccd83f0854-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-05a17fa1-d768-4946-8c65-36ebbc0620ee tempest-ProjectReaderTests-1434632810 None] Lock "cinder-f80b9fe2-a267-4944-af37-17ccd83f0854-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-05a17fa1-d768-4946-8c65-36ebbc0620ee tempest-ProjectReaderTests-1434632810 None] Acquiring lock "cinder-quobyte-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-05a17fa1-d768-4946-8c65-36ebbc0620ee tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-05a17fa1-d768-4946-8c65-36ebbc0620ee tempest-ProjectReaderTests-1434632810 None] Acquiring lock "cinder-quobyte-f80b9fe2-a267-4944-af37-17ccd83f0854" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-05a17fa1-d768-4946-8c65-36ebbc0620ee tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-f80b9fe2-a267-4944-af37-17ccd83f0854" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-05a17fa1-d768-4946-8c65-36ebbc0620ee tempest-ProjectReaderTests-1434632810 None] Deleting offline snapshot f80b9fe2-a267-4944-af37-17ccd83f0854 of volume 99106df9-24cf-44c3-a2ac-9b5af6f2cbf2 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-05a17fa1-d768-4946-8c65-36ebbc0620ee tempest-ProjectReaderTests-1434632810 None] snapshot_file for this snap is: volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.f80b9fe2-a267-4944-af37-17ccd83f0854 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77c656a-3c8b-4df4-bb14-ceefea9d2bf7]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05a17fa1-d768-4946-8c65-36ebbc0620ee tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.f80b9fe2-a267-4944-af37-17ccd83f0854 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:18 devstack sudo[108887]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-b0add377-53c1-4dea-8fee-977bcef1c285 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.683s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-b0add377-53c1-4dea-8fee-977bcef1c285 tempest-ProjectMemberTests-1744160227 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:32:18 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-b0add377-53c1-4dea-8fee-977bcef1c285 tempest-ProjectMemberTests-1744160227 None] Deleted volume successfully. Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-b0add377-53c1-4dea-8fee-977bcef1c285 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-7a4e7619-4932-43ac-8c5c-ddf2dabbfb44-delete_volume" released by "delete_volume" :: held 2.460s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:18 devstack sudo[108890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.f80b9fe2-a267-4944-af37-17ccd83f0854 Jul 03 01:32:18 devstack sudo[108890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Flow 'volume_create_manager' (1d08814e-5a98-410b-b8a3-d9c1093a9f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4ff4c0-9652-4d14-9329-21c337c35ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4ff4c0-9652-4d14-9329-21c337c35ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1347481400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1639e5a-2056-44aa-9bbc-325949d8d3eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970504d68ec94910bf67dae1490927d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:32:18Z,use_quota=True,user_id='bc9ce9ff10bf4b2cada6d0ec88b24ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc5504b-e543-47ff-b73d-7bce2a6aa899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc5504b-e543-47ff-b73d-7bce2a6aa899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e35033c-5ef1-4695-808d-cfcaf9c16c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e35033c-5ef1-4695-808d-cfcaf9c16c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1639e5a-2056-44aa-9bbc-325949d8d3eb', 'volume_name': 'volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e7cc34-8956-4fc3-859e-bc494d97bcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e7cc34-8956-4fc3-859e-bc494d97bcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f83c528-ab0c-4e42-97bc-ef1f3a273971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:18 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Volume f1639e5a-2056-44aa-9bbc-325949d8d3eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb', 'volume_size': 1} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1347481400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1639e5a-2056-44aa-9bbc-325949d8d3eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970504d68ec94910bf67dae1490927d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:32:18Z,use_quota=True,user_id='bc9ce9ff10bf4b2cada6d0ec88b24ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Creating volume f1639e5a-2056-44aa-9bbc-325949d8d3eb {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:32:18 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:18 devstack sudo[108892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb 1073741824 Jul 03 01:32:18 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:18 devstack sudo[108890]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05a17fa1-d768-4946-8c65-36ebbc0620ee tempest-ProjectReaderTests-1434632810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.f80b9fe2-a267-4944-af37-17ccd83f0854" returned: 0 in 0.787s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-05a17fa1-d768-4946-8c65-36ebbc0620ee tempest-ProjectReaderTests-1434632810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81e5d4e-1197-4969-951f-b523f84c47c4]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:18 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05a17fa1-d768-4946-8c65-36ebbc0620ee tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:19 devstack sudo[108897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2 Jul 03 01:32:19 devstack sudo[108897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:19 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb 1073741824" returned: 0 in 0.834s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:19 devstack sudo[108902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb Jul 03 01:32:19 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:19 devstack sudo[108897]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05a17fa1-d768-4946-8c65-36ebbc0620ee tempest-ProjectReaderTests-1434632810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2" returned: 0 in 0.763s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:19 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05a17fa1-d768-4946-8c65-36ebbc0620ee tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.f80b9fe2-a267-4944-af37-17ccd83f0854 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:19 devstack sudo[108907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.f80b9fe2-a267-4944-af37-17ccd83f0854 Jul 03 01:32:19 devstack sudo[108907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:20 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb" returned: 0 in 0.650s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:32:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f83c528-ab0c-4e42-97bc-ef1f3a273971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d4163a-daef-4012-a1ce-4af60fa9ca30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:20 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Volume volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb (f1639e5a-2056-44aa-9bbc-325949d8d3eb): created successfully Jul 03 01:32:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d4163a-daef-4012-a1ce-4af60fa9ca30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:20 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Flow 'volume_create_manager' (1d08814e-5a98-410b-b8a3-d9c1093a9f57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:32:20 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-9e4da17e-de6b-4d4c-9a0f-a838ac8d5bb8 tempest-ProjectMemberTests-1744160227 None] Created volume successfully. Jul 03 01:32:20 devstack sudo[108907]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05a17fa1-d768-4946-8c65-36ebbc0620ee tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.f80b9fe2-a267-4944-af37-17ccd83f0854" returned: 0 in 0.737s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05a17fa1-d768-4946-8c65-36ebbc0620ee tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.f80b9fe2-a267-4944-af37-17ccd83f0854 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:20 devstack sudo[108913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.f80b9fe2-a267-4944-af37-17ccd83f0854 Jul 03 01:32:20 devstack sudo[108913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-833219f1-c5be-49a3-9872-1c0be9cf6ca6 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-833219f1-c5be-49a3-9872-1c0be9cf6ca6 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:20 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-833219f1-c5be-49a3-9872-1c0be9cf6ca6 tempest-ProjectMemberTests-1744160227 None] Creating offline snapshot e54e8fac-6892-4c09-add6-eef9f696fbc8 of volume f1639e5a-2056-44aa-9bbc-325949d8d3eb {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:32:20 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b833af4-8690-4f0f-a7be-502b8c72b6f5]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:20 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-833219f1-c5be-49a3-9872-1c0be9cf6ca6 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:20 devstack sudo[108915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb Jul 03 01:32:20 devstack sudo[108915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:21 devstack sudo[108913]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05a17fa1-d768-4946-8c65-36ebbc0620ee tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2.f80b9fe2-a267-4944-af37-17ccd83f0854" returned: 0 in 0.649s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-05a17fa1-d768-4946-8c65-36ebbc0620ee tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-f80b9fe2-a267-4944-af37-17ccd83f0854" released by "_delete_snapshot" :: held 3.052s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-05a17fa1-d768-4946-8c65-36ebbc0620ee tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2" released by "delete_snapshot" :: held 3.082s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:21 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-05a17fa1-d768-4946-8c65-36ebbc0620ee tempest-ProjectReaderTests-1434632810 None] Created reservations ['e7b6629b-4cdb-4a6f-8f88-1e3d597516d4', 'a8eebc6b-2a73-4f69-ac67-bac41b3f6f91', '104bcf8e-2823-41b8-a05e-3afd53ea66ed', '02a96ae7-b3da-4036-98b0-c8d3f781e596'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:32:21 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-05a17fa1-d768-4946-8c65-36ebbc0620ee tempest-ProjectReaderTests-1434632810 None] Delete snapshot completed successfully. Jul 03 01:32:21 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-05a17fa1-d768-4946-8c65-36ebbc0620ee tempest-ProjectReaderTests-1434632810 None] Lock "cinder-f80b9fe2-a267-4944-af37-17ccd83f0854-delete_snapshot" released by "delete_snapshot" :: held 3.234s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:21 devstack sudo[108915]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-833219f1-c5be-49a3-9872-1c0be9cf6ca6 tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb" returned: 0 in 0.766s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:21 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-833219f1-c5be-49a3-9872-1c0be9cf6ca6 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.e54e8fac-6892-4c09-add6-eef9f696fbc8 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:21 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.e54e8fac-6892-4c09-add6-eef9f696fbc8 1G Jul 03 01:32:21 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6a1b9e6a-6e55-48ba-afb2-95b4c6869194 tempest-ProjectReaderTests-1434632810 None] Acquiring lock "cinder-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6a1b9e6a-6e55-48ba-afb2-95b4c6869194 tempest-ProjectReaderTests-1434632810 None] Lock "cinder-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6a1b9e6a-6e55-48ba-afb2-95b4c6869194 tempest-ProjectReaderTests-1434632810 None] Acquiring lock "cinder-quobyte-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:22 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:22 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6a1b9e6a-6e55-48ba-afb2-95b4c6869194 tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-833219f1-c5be-49a3-9872-1c0be9cf6ca6 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.e54e8fac-6892-4c09-add6-eef9f696fbc8 1G" returned: 0 in 0.853s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-833219f1-c5be-49a3-9872-1c0be9cf6ca6 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.e54e8fac-6892-4c09-add6-eef9f696fbc8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:22 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7420cce9-dc05-4142-bae2-f62717b4ca88]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:22 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6a1b9e6a-6e55-48ba-afb2-95b4c6869194 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:22 devstack sudo[108929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.e54e8fac-6892-4c09-add6-eef9f696fbc8 Jul 03 01:32:22 devstack sudo[108929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:22 devstack sudo[108930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2 Jul 03 01:32:22 devstack sudo[108930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:23 devstack sudo[108929]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-833219f1-c5be-49a3-9872-1c0be9cf6ca6 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.e54e8fac-6892-4c09-add6-eef9f696fbc8" returned: 0 in 0.735s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:23 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-833219f1-c5be-49a3-9872-1c0be9cf6ca6 tempest-ProjectMemberTests-1744160227 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.e54e8fac-6892-4c09-add6-eef9f696fbc8 is being set with open permissions: ugo+rw Jul 03 01:32:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-833219f1-c5be-49a3-9872-1c0be9cf6ca6 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.e54e8fac-6892-4c09-add6-eef9f696fbc8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:23 devstack sudo[108975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.e54e8fac-6892-4c09-add6-eef9f696fbc8 Jul 03 01:32:23 devstack sudo[108975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:23 devstack sudo[108930]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6a1b9e6a-6e55-48ba-afb2-95b4c6869194 tempest-ProjectReaderTests-1434632810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2" returned: 0 in 0.796s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6a1b9e6a-6e55-48ba-afb2-95b4c6869194 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:23 devstack sudo[108977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2 Jul 03 01:32:23 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:23 devstack sudo[108975]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-833219f1-c5be-49a3-9872-1c0be9cf6ca6 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.e54e8fac-6892-4c09-add6-eef9f696fbc8" returned: 0 in 0.701s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:23 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6a1b9e6a-6e55-48ba-afb2-95b4c6869194 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2" returned: 0 in 0.673s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:23 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-833219f1-c5be-49a3-9872-1c0be9cf6ca6 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:23 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6a1b9e6a-6e55-48ba-afb2-95b4c6869194 tempest-ProjectReaderTests-1434632810 None] Lock "cinder-quobyte-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2" released by "delete_volume" :: held 1.552s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:23 devstack sudo[108981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.info Jul 03 01:32:23 devstack sudo[108981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:23 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-6a1b9e6a-6e55-48ba-afb2-95b4c6869194 tempest-ProjectReaderTests-1434632810 None] Created reservations ['8a7d02f0-197f-4a00-b148-0e22feb71d99', '6500e4a2-5164-4649-8376-e08476b4c2ac', '4e1f2357-d81c-4922-ad9b-5571609fc2c8', 'dd5c71dd-2c3d-43bf-946f-4ec2e6818622'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:32:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6a1b9e6a-6e55-48ba-afb2-95b4c6869194 tempest-ProjectReaderTests-1434632810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6a1b9e6a-6e55-48ba-afb2-95b4c6869194 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6a1b9e6a-6e55-48ba-afb2-95b4c6869194 tempest-ProjectReaderTests-1434632810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:32:24 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6a1b9e6a-6e55-48ba-afb2-95b4c6869194 tempest-ProjectReaderTests-1434632810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:32:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6a1b9e6a-6e55-48ba-afb2-95b4c6869194 tempest-ProjectReaderTests-1434632810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6a1b9e6a-6e55-48ba-afb2-95b4c6869194 tempest-ProjectReaderTests-1434632810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:24 devstack sudo[108983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:32:24 devstack sudo[108983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:24 devstack sudo[108981]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-833219f1-c5be-49a3-9872-1c0be9cf6ca6 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.info" returned: 0 in 0.692s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:24 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-833219f1-c5be-49a3-9872-1c0be9cf6ca6 tempest-ProjectMemberTests-1744160227 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.info is being set with open permissions: ugo+rw Jul 03 01:32:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-833219f1-c5be-49a3-9872-1c0be9cf6ca6 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:24 devstack sudo[108987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.info Jul 03 01:32:24 devstack sudo[108987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:24 devstack sudo[108983]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:24 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6a1b9e6a-6e55-48ba-afb2-95b4c6869194 tempest-ProjectReaderTests-1434632810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.655s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:24 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-6a1b9e6a-6e55-48ba-afb2-95b4c6869194 tempest-ProjectReaderTests-1434632810 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:32:24 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6a1b9e6a-6e55-48ba-afb2-95b4c6869194 tempest-ProjectReaderTests-1434632810 None] Deleted volume successfully. Jul 03 01:32:24 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-6a1b9e6a-6e55-48ba-afb2-95b4c6869194 tempest-ProjectReaderTests-1434632810 None] Lock "cinder-99106df9-24cf-44c3-a2ac-9b5af6f2cbf2-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:25 devstack sudo[108987]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-833219f1-c5be-49a3-9872-1c0be9cf6ca6 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.info" returned: 0 in 0.679s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:25 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-833219f1-c5be-49a3-9872-1c0be9cf6ca6 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.557s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:25 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-833219f1-c5be-49a3-9872-1c0be9cf6ca6 tempest-ProjectMemberTests-1744160227 None] Create snapshot completed successfully Jul 03 01:32:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-21a855bd-e92f-4bb7-ad1f-8127662a3ff7 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-e54e8fac-6892-4c09-add6-eef9f696fbc8-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-21a855bd-e92f-4bb7-ad1f-8127662a3ff7 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-e54e8fac-6892-4c09-add6-eef9f696fbc8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-21a855bd-e92f-4bb7-ad1f-8127662a3ff7 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-f1639e5a-2056-44aa-9bbc-325949d8d3eb" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-21a855bd-e92f-4bb7-ad1f-8127662a3ff7 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-f1639e5a-2056-44aa-9bbc-325949d8d3eb" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-21a855bd-e92f-4bb7-ad1f-8127662a3ff7 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-e54e8fac-6892-4c09-add6-eef9f696fbc8" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:26 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-21a855bd-e92f-4bb7-ad1f-8127662a3ff7 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-e54e8fac-6892-4c09-add6-eef9f696fbc8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-21a855bd-e92f-4bb7-ad1f-8127662a3ff7 tempest-ProjectMemberTests-1744160227 None] Deleting offline snapshot e54e8fac-6892-4c09-add6-eef9f696fbc8 of volume f1639e5a-2056-44aa-9bbc-325949d8d3eb {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:32:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-21a855bd-e92f-4bb7-ad1f-8127662a3ff7 tempest-ProjectMemberTests-1744160227 None] snapshot_file for this snap is: volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.e54e8fac-6892-4c09-add6-eef9f696fbc8 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:32:26 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[904d8981-a36a-49ca-8fea-0a0ff5c685cd]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a855bd-e92f-4bb7-ad1f-8127662a3ff7 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.e54e8fac-6892-4c09-add6-eef9f696fbc8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:26 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.e54e8fac-6892-4c09-add6-eef9f696fbc8 Jul 03 01:32:26 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:27 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a855bd-e92f-4bb7-ad1f-8127662a3ff7 tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.e54e8fac-6892-4c09-add6-eef9f696fbc8" returned: 0 in 0.790s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-21a855bd-e92f-4bb7-ad1f-8127662a3ff7 tempest-ProjectMemberTests-1744160227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:32:27 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff7e5c9-9f6e-4e0a-a4f8-68c171b0c3b1]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a855bd-e92f-4bb7-ad1f-8127662a3ff7 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:27 devstack sudo[109002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb Jul 03 01:32:27 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:27 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a855bd-e92f-4bb7-ad1f-8127662a3ff7 tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb" returned: 0 in 0.796s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a855bd-e92f-4bb7-ad1f-8127662a3ff7 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.e54e8fac-6892-4c09-add6-eef9f696fbc8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:27 devstack sudo[109007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.e54e8fac-6892-4c09-add6-eef9f696fbc8 Jul 03 01:32:27 devstack sudo[109007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:28 devstack sudo[109007]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a855bd-e92f-4bb7-ad1f-8127662a3ff7 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.e54e8fac-6892-4c09-add6-eef9f696fbc8" returned: 0 in 0.718s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a855bd-e92f-4bb7-ad1f-8127662a3ff7 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.e54e8fac-6892-4c09-add6-eef9f696fbc8 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:28 devstack sudo[109012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.e54e8fac-6892-4c09-add6-eef9f696fbc8 Jul 03 01:32:28 devstack sudo[109012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:29 devstack sudo[109012]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-21a855bd-e92f-4bb7-ad1f-8127662a3ff7 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb.e54e8fac-6892-4c09-add6-eef9f696fbc8" returned: 0 in 0.673s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-21a855bd-e92f-4bb7-ad1f-8127662a3ff7 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-e54e8fac-6892-4c09-add6-eef9f696fbc8" released by "_delete_snapshot" :: held 3.089s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-21a855bd-e92f-4bb7-ad1f-8127662a3ff7 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-f1639e5a-2056-44aa-9bbc-325949d8d3eb" released by "delete_snapshot" :: held 3.112s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:29 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-21a855bd-e92f-4bb7-ad1f-8127662a3ff7 tempest-ProjectMemberTests-1744160227 None] Created reservations ['79cfb994-ca2c-4afe-a9d2-7f3c6b4e76d6', 'f9c95d86-932d-4460-ab9f-2bacf4bc4d36', 'fb93584a-30aa-49a6-8e8e-1b971577d967', 'c9e59d5d-213e-4420-847f-ef20661d1e09'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:32:29 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-21a855bd-e92f-4bb7-ad1f-8127662a3ff7 tempest-ProjectMemberTests-1744160227 None] Delete snapshot completed successfully. Jul 03 01:32:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-21a855bd-e92f-4bb7-ad1f-8127662a3ff7 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-e54e8fac-6892-4c09-add6-eef9f696fbc8-delete_snapshot" released by "delete_snapshot" :: held 3.262s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-587132d3-52ce-4609-aa83-259df612f467 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-f1639e5a-2056-44aa-9bbc-325949d8d3eb-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-587132d3-52ce-4609-aa83-259df612f467 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-f1639e5a-2056-44aa-9bbc-325949d8d3eb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-587132d3-52ce-4609-aa83-259df612f467 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-f1639e5a-2056-44aa-9bbc-325949d8d3eb" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-587132d3-52ce-4609-aa83-259df612f467 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-f1639e5a-2056-44aa-9bbc-325949d8d3eb" acquired by "delete_volume" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:30 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4145d8-c3c1-4b6d-9888-f7db12284676]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-587132d3-52ce-4609-aa83-259df612f467 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:30 devstack sudo[109015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb Jul 03 01:32:30 devstack sudo[109015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:31 devstack sudo[109015]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-587132d3-52ce-4609-aa83-259df612f467 tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb" returned: 0 in 0.814s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-587132d3-52ce-4609-aa83-259df612f467 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:31 devstack sudo[109020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb Jul 03 01:32:31 devstack sudo[109020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:32 devstack sudo[109020]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-587132d3-52ce-4609-aa83-259df612f467 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-f1639e5a-2056-44aa-9bbc-325949d8d3eb" returned: 0 in 0.669s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-587132d3-52ce-4609-aa83-259df612f467 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-f1639e5a-2056-44aa-9bbc-325949d8d3eb" released by "delete_volume" :: held 1.535s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:32 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-587132d3-52ce-4609-aa83-259df612f467 tempest-ProjectMemberTests-1744160227 None] Created reservations ['7aeefc19-456f-42e8-8a77-fa88970acd37', '05d69e7c-9deb-4cbe-a30f-fc9de899ffac', '7e9bf4ac-0a25-4c70-b20a-4a87c9e1aa6b', '843f0670-2e8a-43cd-bbff-8ed5701f814a'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:32:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-587132d3-52ce-4609-aa83-259df612f467 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-587132d3-52ce-4609-aa83-259df612f467 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-587132d3-52ce-4609-aa83-259df612f467 tempest-ProjectMemberTests-1744160227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:32:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-587132d3-52ce-4609-aa83-259df612f467 tempest-ProjectMemberTests-1744160227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:32:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-587132d3-52ce-4609-aa83-259df612f467 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-587132d3-52ce-4609-aa83-259df612f467 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:32 devstack sudo[109023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:32:32 devstack sudo[109023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:32 devstack sudo[109023]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-587132d3-52ce-4609-aa83-259df612f467 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.669s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:32 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-587132d3-52ce-4609-aa83-259df612f467 tempest-ProjectMemberTests-1744160227 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:32:32 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-587132d3-52ce-4609-aa83-259df612f467 tempest-ProjectMemberTests-1744160227 None] Deleted volume successfully. Jul 03 01:32:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-587132d3-52ce-4609-aa83-259df612f467 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-f1639e5a-2056-44aa-9bbc-325949d8d3eb-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:33 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:32:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Flow 'volume_create_manager' (dabca818-9b91-46f9-bb25-839437945795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:32:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (315ea88c-2be7-4c06-81da-0334cc96831d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (315ea88c-2be7-4c06-81da-0334cc96831d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-483498022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57017e08-20a1-424e-99e4-a7b1f9e6ff1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970504d68ec94910bf67dae1490927d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:32:33Z,use_quota=True,user_id='bc9ce9ff10bf4b2cada6d0ec88b24ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae7f52f-1938-4596-b313-c1459d580603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae7f52f-1938-4596-b313-c1459d580603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a303a6-c8ac-4676-9275-a810ff213460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a303a6-c8ac-4676-9275-a810ff213460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57017e08-20a1-424e-99e4-a7b1f9e6ff1c', 'volume_name': 'volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acfba779-680c-4c48-bb99-5bd765931a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acfba779-680c-4c48-bb99-5bd765931a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:33 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a0968d-f397-4522-b0b5-7f95c74ee336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:33 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Volume 57017e08-20a1-424e-99e4-a7b1f9e6ff1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c', 'volume_size': 1} Jul 03 01:32:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-483498022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57017e08-20a1-424e-99e4-a7b1f9e6ff1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970504d68ec94910bf67dae1490927d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:32:33Z,use_quota=True,user_id='bc9ce9ff10bf4b2cada6d0ec88b24ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:32:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Creating volume 57017e08-20a1-424e-99e4-a7b1f9e6ff1c {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:32:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:32:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:32:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:33 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:32:33 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:32:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:33 devstack sudo[109027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c 1073741824 Jul 03 01:32:33 devstack sudo[109027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:34 devstack sudo[109027]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c 1073741824" returned: 0 in 0.961s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:34 devstack sudo[109032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c Jul 03 01:32:34 devstack sudo[109032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:34 devstack sudo[109032]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c" returned: 0 in 0.645s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:32:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a0968d-f397-4522-b0b5-7f95c74ee336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:34 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602a3b5a-86b0-449f-b8df-123a4b6e64b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:35 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Volume volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c (57017e08-20a1-424e-99e4-a7b1f9e6ff1c): created successfully Jul 03 01:32:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602a3b5a-86b0-449f-b8df-123a4b6e64b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Flow 'volume_create_manager' (dabca818-9b91-46f9-bb25-839437945795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:32:35 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-05b47d2e-3b0d-4071-b0a6-f856ba82d3d8 tempest-ProjectMemberTests-1744160227 None] Created volume successfully. Jul 03 01:32:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a8f1a734-db16-4e23-ade8-1b87444a44df tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a8f1a734-db16-4e23-ade8-1b87444a44df tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a8f1a734-db16-4e23-ade8-1b87444a44df tempest-ProjectMemberTests-1744160227 None] Creating offline snapshot 44884064-b40c-4720-ab86-0604f203cd5a of volume 57017e08-20a1-424e-99e4-a7b1f9e6ff1c {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:32:35 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b3b8a3-76fa-4cda-ae5c-d5132016cc59]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a8f1a734-db16-4e23-ade8-1b87444a44df tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:35 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c Jul 03 01:32:35 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:36 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a8f1a734-db16-4e23-ade8-1b87444a44df tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c" returned: 0 in 0.771s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a8f1a734-db16-4e23-ade8-1b87444a44df tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.44884064-b40c-4720-ab86-0604f203cd5a 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:36 devstack sudo[109040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.44884064-b40c-4720-ab86-0604f203cd5a 1G Jul 03 01:32:36 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:36 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:32:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Flow 'volume_create_manager' (b5ffe904-5474-4698-9d51-fa8522bf0e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:32:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4bcb72-c3ee-401c-8e40-f8abbc7be241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4bcb72-c3ee-401c-8e40-f8abbc7be241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1410085413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e82b4fcf-55c4-482e-b8a7-d3170f04988b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f0a0f6c92f49b29ac32f42ce7453f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:32:36Z,use_quota=True,user_id='c75866d684374b0da63f31a0833d33a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c5c56c-55a0-4fee-bac0-5fbaf780e7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c5c56c-55a0-4fee-bac0-5fbaf780e7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc941cd8-b16d-4d47-aff3-a5d4b8d49c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc941cd8-b16d-4d47-aff3-a5d4b8d49c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e82b4fcf-55c4-482e-b8a7-d3170f04988b', 'volume_name': 'volume-e82b4fcf-55c4-482e-b8a7-d3170f04988b', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145e32b9-19f8-4f12-9277-1f53730f93d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145e32b9-19f8-4f12-9277-1f53730f93d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:36 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7fc301-75b2-4459-aab7-2c4ed3a63ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:36 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Volume e82b4fcf-55c4-482e-b8a7-d3170f04988b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e82b4fcf-55c4-482e-b8a7-d3170f04988b', 'volume_size': 1} Jul 03 01:32:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:37 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a8f1a734-db16-4e23-ade8-1b87444a44df tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.44884064-b40c-4720-ab86-0604f203cd5a 1G" returned: 0 in 0.834s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a8f1a734-db16-4e23-ade8-1b87444a44df tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.44884064-b40c-4720-ab86-0604f203cd5a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:37 devstack sudo[109046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.44884064-b40c-4720-ab86-0604f203cd5a Jul 03 01:32:37 devstack sudo[109046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:37 devstack sudo[109046]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a8f1a734-db16-4e23-ade8-1b87444a44df tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.44884064-b40c-4720-ab86-0604f203cd5a" returned: 0 in 0.687s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:37 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-a8f1a734-db16-4e23-ade8-1b87444a44df tempest-ProjectMemberTests-1744160227 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.44884064-b40c-4720-ab86-0604f203cd5a is being set with open permissions: ugo+rw Jul 03 01:32:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a8f1a734-db16-4e23-ade8-1b87444a44df tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.44884064-b40c-4720-ab86-0604f203cd5a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:37 devstack sudo[109051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.44884064-b40c-4720-ab86-0604f203cd5a Jul 03 01:32:37 devstack sudo[109051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:38 devstack sudo[109051]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a8f1a734-db16-4e23-ade8-1b87444a44df tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.44884064-b40c-4720-ab86-0604f203cd5a" returned: 0 in 0.633s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:38 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=83,cinder:INSERT=29,cinder:UPDATE=84,cinder:DELETE=6 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:32:38 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=106,cinder:SELECT=67,cinder:DELETE=10,cinder:INSERT=22 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:32:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a8f1a734-db16-4e23-ade8-1b87444a44df tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:38 devstack sudo[109054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.info Jul 03 01:32:38 devstack sudo[109054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:39 devstack sudo[109054]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a8f1a734-db16-4e23-ade8-1b87444a44df tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.info" returned: 0 in 0.639s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:39 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-a8f1a734-db16-4e23-ade8-1b87444a44df tempest-ProjectMemberTests-1744160227 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.info is being set with open permissions: ugo+rw Jul 03 01:32:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a8f1a734-db16-4e23-ade8-1b87444a44df tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:39 devstack sudo[109057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.info Jul 03 01:32:39 devstack sudo[109057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:39 devstack sudo[109057]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a8f1a734-db16-4e23-ade8-1b87444a44df tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.info" returned: 0 in 0.644s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a8f1a734-db16-4e23-ade8-1b87444a44df tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.294s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.157s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1410085413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e82b4fcf-55c4-482e-b8a7-d3170f04988b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f0a0f6c92f49b29ac32f42ce7453f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:32:36Z,use_quota=True,user_id='c75866d684374b0da63f31a0833d33a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:32:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Creating volume e82b4fcf-55c4-482e-b8a7-d3170f04988b {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:32:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:32:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:32:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:32:39 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:32:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e82b4fcf-55c4-482e-b8a7-d3170f04988b 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:39 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e82b4fcf-55c4-482e-b8a7-d3170f04988b 1073741824 Jul 03 01:32:39 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:39 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a8f1a734-db16-4e23-ade8-1b87444a44df tempest-ProjectMemberTests-1744160227 None] Create snapshot completed successfully Jul 03 01:32:40 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e82b4fcf-55c4-482e-b8a7-d3170f04988b 1073741824" returned: 0 in 0.819s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e82b4fcf-55c4-482e-b8a7-d3170f04988b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:40 devstack sudo[109065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e82b4fcf-55c4-482e-b8a7-d3170f04988b Jul 03 01:32:40 devstack sudo[109065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-602e655a-c055-4aeb-9017-4c95beb70a22 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-44884064-b40c-4720-ab86-0604f203cd5a-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-602e655a-c055-4aeb-9017-4c95beb70a22 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-44884064-b40c-4720-ab86-0604f203cd5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-602e655a-c055-4aeb-9017-4c95beb70a22 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-57017e08-20a1-424e-99e4-a7b1f9e6ff1c" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-602e655a-c055-4aeb-9017-4c95beb70a22 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-57017e08-20a1-424e-99e4-a7b1f9e6ff1c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-602e655a-c055-4aeb-9017-4c95beb70a22 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-44884064-b40c-4720-ab86-0604f203cd5a" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-602e655a-c055-4aeb-9017-4c95beb70a22 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-44884064-b40c-4720-ab86-0604f203cd5a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-602e655a-c055-4aeb-9017-4c95beb70a22 tempest-ProjectMemberTests-1744160227 None] Deleting offline snapshot 44884064-b40c-4720-ab86-0604f203cd5a of volume 57017e08-20a1-424e-99e4-a7b1f9e6ff1c {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:32:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-602e655a-c055-4aeb-9017-4c95beb70a22 tempest-ProjectMemberTests-1744160227 None] snapshot_file for this snap is: volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.44884064-b40c-4720-ab86-0604f203cd5a {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:32:40 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd13f31-4394-4f49-a05b-6722d53024d6]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-602e655a-c055-4aeb-9017-4c95beb70a22 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.44884064-b40c-4720-ab86-0604f203cd5a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:41 devstack sudo[109067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.44884064-b40c-4720-ab86-0604f203cd5a Jul 03 01:32:41 devstack sudo[109067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:41 devstack sudo[109065]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e82b4fcf-55c4-482e-b8a7-d3170f04988b" returned: 0 in 0.690s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:32:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7fc301-75b2-4459-aab7-2c4ed3a63ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e82b4fcf-55c4-482e-b8a7-d3170f04988b', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9bffb1-fc7d-47d2-ad75-ad06b1b205d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:41 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Volume volume-e82b4fcf-55c4-482e-b8a7-d3170f04988b (e82b4fcf-55c4-482e-b8a7-d3170f04988b): created successfully Jul 03 01:32:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9bffb1-fc7d-47d2-ad75-ad06b1b205d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:41 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Flow 'volume_create_manager' (b5ffe904-5474-4698-9d51-fa8522bf0e3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:32:41 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-6aa77a10-dad0-4cfa-9224-1d037cc1f643 tempest-ProjectReaderTests-972353395 None] Created volume successfully. Jul 03 01:32:41 devstack sudo[109067]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-602e655a-c055-4aeb-9017-4c95beb70a22 tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.44884064-b40c-4720-ab86-0604f203cd5a" returned: 0 in 0.806s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-602e655a-c055-4aeb-9017-4c95beb70a22 tempest-ProjectMemberTests-1744160227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:32:41 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b049c4b2-14b7-42f9-a2e1-aaa932ef0d5b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-602e655a-c055-4aeb-9017-4c95beb70a22 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:41 devstack sudo[109073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c Jul 03 01:32:41 devstack sudo[109073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e2c515d7-f73c-4125-9260-1b145648a5ca tempest-ProjectReaderTests-972353395 None] Acquiring lock "cinder-e82b4fcf-55c4-482e-b8a7-d3170f04988b-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:41 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e2c515d7-f73c-4125-9260-1b145648a5ca tempest-ProjectReaderTests-972353395 None] Lock "cinder-e82b4fcf-55c4-482e-b8a7-d3170f04988b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e2c515d7-f73c-4125-9260-1b145648a5ca tempest-ProjectReaderTests-972353395 None] Acquiring lock "cinder-quobyte-e82b4fcf-55c4-482e-b8a7-d3170f04988b" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e2c515d7-f73c-4125-9260-1b145648a5ca tempest-ProjectReaderTests-972353395 None] Lock "cinder-quobyte-e82b4fcf-55c4-482e-b8a7-d3170f04988b" acquired by "delete_volume" :: waited 0.014s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:42 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd156a84-3f6d-4ef9-9991-0c52338ed755]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2c515d7-f73c-4125-9260-1b145648a5ca tempest-ProjectReaderTests-972353395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e82b4fcf-55c4-482e-b8a7-d3170f04988b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:42 devstack sudo[109075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e82b4fcf-55c4-482e-b8a7-d3170f04988b Jul 03 01:32:42 devstack sudo[109075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:42 devstack sudo[109073]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-602e655a-c055-4aeb-9017-4c95beb70a22 tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c" returned: 0 in 0.853s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-602e655a-c055-4aeb-9017-4c95beb70a22 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.44884064-b40c-4720-ab86-0604f203cd5a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:42 devstack sudo[109081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.44884064-b40c-4720-ab86-0604f203cd5a Jul 03 01:32:42 devstack sudo[109081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:42 devstack sudo[109075]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2c515d7-f73c-4125-9260-1b145648a5ca tempest-ProjectReaderTests-972353395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e82b4fcf-55c4-482e-b8a7-d3170f04988b" returned: 0 in 0.787s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2c515d7-f73c-4125-9260-1b145648a5ca tempest-ProjectReaderTests-972353395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e82b4fcf-55c4-482e-b8a7-d3170f04988b {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:42 devstack sudo[109086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e82b4fcf-55c4-482e-b8a7-d3170f04988b Jul 03 01:32:42 devstack sudo[109086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:43 devstack sudo[109081]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-602e655a-c055-4aeb-9017-4c95beb70a22 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.44884064-b40c-4720-ab86-0604f203cd5a" returned: 0 in 0.775s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-602e655a-c055-4aeb-9017-4c95beb70a22 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.44884064-b40c-4720-ab86-0604f203cd5a {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:43 devstack sudo[109092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.44884064-b40c-4720-ab86-0604f203cd5a Jul 03 01:32:43 devstack sudo[109092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:43 devstack sudo[109086]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2c515d7-f73c-4125-9260-1b145648a5ca tempest-ProjectReaderTests-972353395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-e82b4fcf-55c4-482e-b8a7-d3170f04988b" returned: 0 in 0.644s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:43 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e2c515d7-f73c-4125-9260-1b145648a5ca tempest-ProjectReaderTests-972353395 None] Lock "cinder-quobyte-e82b4fcf-55c4-482e-b8a7-d3170f04988b" released by "delete_volume" :: held 1.475s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:43 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-e2c515d7-f73c-4125-9260-1b145648a5ca tempest-ProjectReaderTests-972353395 None] Created reservations ['0c0595ce-bb57-45c9-89c7-a987de9c17ed', '81058eaf-3150-427c-8a0a-4b27c5c375bb', 'f98e4308-73ee-4d33-8302-cb67b8157b42', 'f0ce2265-43c6-4913-9da8-1883200f3669'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:32:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e2c515d7-f73c-4125-9260-1b145648a5ca tempest-ProjectReaderTests-972353395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e2c515d7-f73c-4125-9260-1b145648a5ca tempest-ProjectReaderTests-972353395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e2c515d7-f73c-4125-9260-1b145648a5ca tempest-ProjectReaderTests-972353395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:32:43 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-e2c515d7-f73c-4125-9260-1b145648a5ca tempest-ProjectReaderTests-972353395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:32:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-e2c515d7-f73c-4125-9260-1b145648a5ca tempest-ProjectReaderTests-972353395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2c515d7-f73c-4125-9260-1b145648a5ca tempest-ProjectReaderTests-972353395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:43 devstack sudo[109094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:32:43 devstack sudo[109094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:44 devstack sudo[109092]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-602e655a-c055-4aeb-9017-4c95beb70a22 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c.44884064-b40c-4720-ab86-0604f203cd5a" returned: 0 in 0.715s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-602e655a-c055-4aeb-9017-4c95beb70a22 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-44884064-b40c-4720-ab86-0604f203cd5a" released by "_delete_snapshot" :: held 3.249s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-602e655a-c055-4aeb-9017-4c95beb70a22 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-57017e08-20a1-424e-99e4-a7b1f9e6ff1c" released by "delete_snapshot" :: held 3.274s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-602e655a-c055-4aeb-9017-4c95beb70a22 tempest-ProjectMemberTests-1744160227 None] Created reservations ['438193f2-0af2-4c03-9b2b-3542b3a119b6', 'a6d5d415-05f1-499f-8b0f-ae7b1116b3a3', 'e5ba3b45-cf10-410c-9f7a-bcda0bff193f', 'c79cce67-5d85-43e5-a8a1-5217d6a27048'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:32:44 devstack sudo[109094]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-e2c515d7-f73c-4125-9260-1b145648a5ca tempest-ProjectReaderTests-972353395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.700s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-e2c515d7-f73c-4125-9260-1b145648a5ca tempest-ProjectReaderTests-972353395 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:32:44 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-e2c515d7-f73c-4125-9260-1b145648a5ca tempest-ProjectReaderTests-972353395 None] Deleted volume successfully. Jul 03 01:32:44 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-602e655a-c055-4aeb-9017-4c95beb70a22 tempest-ProjectMemberTests-1744160227 None] Delete snapshot completed successfully. Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-602e655a-c055-4aeb-9017-4c95beb70a22 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-44884064-b40c-4720-ab86-0604f203cd5a-delete_snapshot" released by "delete_snapshot" :: held 3.451s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-e2c515d7-f73c-4125-9260-1b145648a5ca tempest-ProjectReaderTests-972353395 None] Lock "cinder-e82b4fcf-55c4-482e-b8a7-d3170f04988b-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Flow 'volume_create_manager' (b43c5500-a900-4cc0-86fa-7540b066152f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58608dcf-b74d-415a-a2f3-f8e213fd6c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58608dcf-b74d-415a-a2f3-f8e213fd6c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-236464344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73319442-57de-4618-8e54-99d9079f0aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f0a0f6c92f49b29ac32f42ce7453f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:32:45Z,use_quota=True,user_id='c75866d684374b0da63f31a0833d33a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b7e322-b929-4053-a6ac-2a7a633896e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b7e322-b929-4053-a6ac-2a7a633896e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a08c72-159c-4dc9-9e5e-44bedd6630df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a08c72-159c-4dc9-9e5e-44bedd6630df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73319442-57de-4618-8e54-99d9079f0aed', 'volume_name': 'volume-73319442-57de-4618-8e54-99d9079f0aed', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224a99b1-669b-479c-83b4-a1d3efb546b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224a99b1-669b-479c-83b4-a1d3efb546b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0351ee4-5510-4380-b29e-5caa79f0f464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:44 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Volume 73319442-57de-4618-8e54-99d9079f0aed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73319442-57de-4618-8e54-99d9079f0aed', 'volume_size': 1} Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-236464344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73319442-57de-4618-8e54-99d9079f0aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47f0a0f6c92f49b29ac32f42ce7453f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:32:45Z,use_quota=True,user_id='c75866d684374b0da63f31a0833d33a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Creating volume 73319442-57de-4618-8e54-99d9079f0aed {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:32:44 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:32:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-73319442-57de-4618-8e54-99d9079f0aed 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:44 devstack sudo[109098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-73319442-57de-4618-8e54-99d9079f0aed 1073741824 Jul 03 01:32:44 devstack sudo[109098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ba5509fb-b540-4b44-be8b-2a3dd948eb0e tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-57017e08-20a1-424e-99e4-a7b1f9e6ff1c-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ba5509fb-b540-4b44-be8b-2a3dd948eb0e tempest-ProjectMemberTests-1744160227 None] Lock "cinder-57017e08-20a1-424e-99e4-a7b1f9e6ff1c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ba5509fb-b540-4b44-be8b-2a3dd948eb0e tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-57017e08-20a1-424e-99e4-a7b1f9e6ff1c" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:45 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ba5509fb-b540-4b44-be8b-2a3dd948eb0e tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-57017e08-20a1-424e-99e4-a7b1f9e6ff1c" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:45 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[892808ad-b5eb-4325-a29e-836e710d2d12]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ba5509fb-b540-4b44-be8b-2a3dd948eb0e tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:45 devstack sudo[109100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c Jul 03 01:32:45 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:45 devstack sudo[109098]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-73319442-57de-4618-8e54-99d9079f0aed 1073741824" returned: 0 in 0.897s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:45 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-73319442-57de-4618-8e54-99d9079f0aed {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:45 devstack sudo[109105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-73319442-57de-4618-8e54-99d9079f0aed Jul 03 01:32:45 devstack sudo[109105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:46 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ba5509fb-b540-4b44-be8b-2a3dd948eb0e tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c" returned: 0 in 0.846s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ba5509fb-b540-4b44-be8b-2a3dd948eb0e tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:46 devstack sudo[109110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c Jul 03 01:32:46 devstack sudo[109110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:46 devstack sudo[109105]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-73319442-57de-4618-8e54-99d9079f0aed" returned: 0 in 0.701s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:32:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0351ee4-5510-4380-b29e-5caa79f0f464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73319442-57de-4618-8e54-99d9079f0aed', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d13075ee-63a6-4754-81ef-424f90e7eeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:46 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Volume volume-73319442-57de-4618-8e54-99d9079f0aed (73319442-57de-4618-8e54-99d9079f0aed): created successfully Jul 03 01:32:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d13075ee-63a6-4754-81ef-424f90e7eeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:46 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Flow 'volume_create_manager' (b43c5500-a900-4cc0-86fa-7540b066152f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:32:46 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-387e3cd9-87ce-47ec-ab24-995d691047c5 tempest-ProjectReaderTests-972353395 None] Created volume successfully. Jul 03 01:32:46 devstack sudo[109110]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ba5509fb-b540-4b44-be8b-2a3dd948eb0e tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-57017e08-20a1-424e-99e4-a7b1f9e6ff1c" returned: 0 in 0.678s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ae8a05f2-2434-46a1-a850-042582e3b024 tempest-ProjectReaderTests-972353395 None] Acquiring lock "cinder-73319442-57de-4618-8e54-99d9079f0aed-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ba5509fb-b540-4b44-be8b-2a3dd948eb0e tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-57017e08-20a1-424e-99e4-a7b1f9e6ff1c" released by "delete_volume" :: held 1.600s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ae8a05f2-2434-46a1-a850-042582e3b024 tempest-ProjectReaderTests-972353395 None] Lock "cinder-73319442-57de-4618-8e54-99d9079f0aed-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ae8a05f2-2434-46a1-a850-042582e3b024 tempest-ProjectReaderTests-972353395 None] Acquiring lock "cinder-quobyte-73319442-57de-4618-8e54-99d9079f0aed" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:46 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-ba5509fb-b540-4b44-be8b-2a3dd948eb0e tempest-ProjectMemberTests-1744160227 None] Created reservations ['e1018672-be7b-4b7f-860e-6fd87e18efcb', '52efda2f-19ae-4f90-bac4-84b8ab537d34', '0bc4917e-5820-48ab-8a3a-2877c0eddaeb', 'd39fe961-832d-427b-abdd-0dbd63eba4d4'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:32:46 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ae8a05f2-2434-46a1-a850-042582e3b024 tempest-ProjectReaderTests-972353395 None] Lock "cinder-quobyte-73319442-57de-4618-8e54-99d9079f0aed" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:46 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[794373b2-226c-4ac3-9dca-9222128af724]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ae8a05f2-2434-46a1-a850-042582e3b024 tempest-ProjectReaderTests-972353395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-73319442-57de-4618-8e54-99d9079f0aed {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ba5509fb-b540-4b44-be8b-2a3dd948eb0e tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ba5509fb-b540-4b44-be8b-2a3dd948eb0e tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ba5509fb-b540-4b44-be8b-2a3dd948eb0e tempest-ProjectMemberTests-1744160227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:32:46 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ba5509fb-b540-4b44-be8b-2a3dd948eb0e tempest-ProjectMemberTests-1744160227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:32:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ba5509fb-b540-4b44-be8b-2a3dd948eb0e tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:46 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ba5509fb-b540-4b44-be8b-2a3dd948eb0e tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:46 devstack sudo[109115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:32:46 devstack sudo[109115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:47 devstack sudo[109114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-73319442-57de-4618-8e54-99d9079f0aed Jul 03 01:32:47 devstack sudo[109114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:47 devstack sudo[109115]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ba5509fb-b540-4b44-be8b-2a3dd948eb0e tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.704s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-ba5509fb-b540-4b44-be8b-2a3dd948eb0e tempest-ProjectMemberTests-1744160227 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:32:47 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ba5509fb-b540-4b44-be8b-2a3dd948eb0e tempest-ProjectMemberTests-1744160227 None] Deleted volume successfully. Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ba5509fb-b540-4b44-be8b-2a3dd948eb0e tempest-ProjectMemberTests-1744160227 None] Lock "cinder-57017e08-20a1-424e-99e4-a7b1f9e6ff1c-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:47 devstack sudo[109114]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ae8a05f2-2434-46a1-a850-042582e3b024 tempest-ProjectReaderTests-972353395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-73319442-57de-4618-8e54-99d9079f0aed" returned: 0 in 0.875s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ae8a05f2-2434-46a1-a850-042582e3b024 tempest-ProjectReaderTests-972353395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-73319442-57de-4618-8e54-99d9079f0aed {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:47 devstack sudo[109122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-73319442-57de-4618-8e54-99d9079f0aed Jul 03 01:32:47 devstack sudo[109122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Flow 'volume_create_manager' (05d37d3f-75bd-4223-bb38-9879aaa361e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ee661c8-d177-4e73-ba94-76335350e7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ee661c8-d177-4e73-ba94-76335350e7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2097943681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb4543a5-a94c-4894-a67a-e4ab5b2df588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970504d68ec94910bf67dae1490927d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:32:48Z,use_quota=True,user_id='bc9ce9ff10bf4b2cada6d0ec88b24ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43bddf5b-1875-40c9-a588-09ad58cafc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43bddf5b-1875-40c9-a588-09ad58cafc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9e987d-a2a4-4e08-8f6d-830a22873e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9e987d-a2a4-4e08-8f6d-830a22873e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb4543a5-a94c-4894-a67a-e4ab5b2df588', 'volume_name': 'volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9adba831-f2a3-44c1-a2b7-76c90d58679f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9adba831-f2a3-44c1-a2b7-76c90d58679f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dbe7848-5a0f-4475-890b-dc16d3085fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:47 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Volume bb4543a5-a94c-4894-a67a-e4ab5b2df588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588', 'volume_size': 1} Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2097943681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb4543a5-a94c-4894-a67a-e4ab5b2df588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970504d68ec94910bf67dae1490927d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:32:48Z,use_quota=True,user_id='bc9ce9ff10bf4b2cada6d0ec88b24ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Creating volume bb4543a5-a94c-4894-a67a-e4ab5b2df588 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:32:47 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:32:47 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:48 devstack sudo[109124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588 1073741824 Jul 03 01:32:48 devstack sudo[109124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:48 devstack sudo[109122]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ae8a05f2-2434-46a1-a850-042582e3b024 tempest-ProjectReaderTests-972353395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-73319442-57de-4618-8e54-99d9079f0aed" returned: 0 in 0.696s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:48 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ae8a05f2-2434-46a1-a850-042582e3b024 tempest-ProjectReaderTests-972353395 None] Lock "cinder-quobyte-73319442-57de-4618-8e54-99d9079f0aed" released by "delete_volume" :: held 1.617s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:48 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-ae8a05f2-2434-46a1-a850-042582e3b024 tempest-ProjectReaderTests-972353395 None] Created reservations ['2a4cd23c-5b0f-4170-a835-dedbe909028a', 'cffc173b-74e9-4d85-a574-9f6acd616872', 'abf10e3d-d66a-49bc-a20c-90f88f784c26', '5258e85f-98ee-4129-a61a-5c2f388c7aee'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:32:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ae8a05f2-2434-46a1-a850-042582e3b024 tempest-ProjectReaderTests-972353395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ae8a05f2-2434-46a1-a850-042582e3b024 tempest-ProjectReaderTests-972353395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ae8a05f2-2434-46a1-a850-042582e3b024 tempest-ProjectReaderTests-972353395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:32:48 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ae8a05f2-2434-46a1-a850-042582e3b024 tempest-ProjectReaderTests-972353395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:32:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ae8a05f2-2434-46a1-a850-042582e3b024 tempest-ProjectReaderTests-972353395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ae8a05f2-2434-46a1-a850-042582e3b024 tempest-ProjectReaderTests-972353395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:48 devstack sudo[109130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:32:48 devstack sudo[109130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:48 devstack sudo[109124]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588 1073741824" returned: 0 in 0.924s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:48 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:48 devstack sudo[109133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588 Jul 03 01:32:48 devstack sudo[109133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:49 devstack sudo[109130]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ae8a05f2-2434-46a1-a850-042582e3b024 tempest-ProjectReaderTests-972353395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.704s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:49 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-ae8a05f2-2434-46a1-a850-042582e3b024 tempest-ProjectReaderTests-972353395 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:32:49 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ae8a05f2-2434-46a1-a850-042582e3b024 tempest-ProjectReaderTests-972353395 None] Deleted volume successfully. Jul 03 01:32:49 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ae8a05f2-2434-46a1-a850-042582e3b024 tempest-ProjectReaderTests-972353395 None] Lock "cinder-73319442-57de-4618-8e54-99d9079f0aed-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:49 devstack sudo[109133]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588" returned: 0 in 0.679s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:49 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:32:49 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dbe7848-5a0f-4475-890b-dc16d3085fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2afcd7-dea1-45a4-9115-4e431c1f4b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:32:49 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Volume volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588 (bb4543a5-a94c-4894-a67a-e4ab5b2df588): created successfully Jul 03 01:32:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2afcd7-dea1-45a4-9115-4e431c1f4b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:32:49 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Flow 'volume_create_manager' (05d37d3f-75bd-4223-bb38-9879aaa361e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:32:49 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-49f3de3d-f69b-4b32-997e-67eb0f56b2b4 tempest-ProjectMemberTests-1744160227 None] Created volume successfully. Jul 03 01:32:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1fc106fd-26f5-4f05-93b1-b02fcd42f831 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:32:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1fc106fd-26f5-4f05-93b1-b02fcd42f831 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:32:50 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-1fc106fd-26f5-4f05-93b1-b02fcd42f831 tempest-ProjectMemberTests-1744160227 None] Creating offline snapshot 0b1b4d5b-06ac-4cd7-b855-a05aba619f43 of volume bb4543a5-a94c-4894-a67a-e4ab5b2df588 {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:32:50 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c854fd5e-0a2c-452c-9524-3e5338ad294b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1fc106fd-26f5-4f05-93b1-b02fcd42f831 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:50 devstack sudo[109137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588 Jul 03 01:32:50 devstack sudo[109137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:50 devstack sudo[109137]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1fc106fd-26f5-4f05-93b1-b02fcd42f831 tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588" returned: 0 in 0.814s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:50 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1fc106fd-26f5-4f05-93b1-b02fcd42f831 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.0b1b4d5b-06ac-4cd7-b855-a05aba619f43 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:50 devstack sudo[109142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.0b1b4d5b-06ac-4cd7-b855-a05aba619f43 1G Jul 03 01:32:50 devstack sudo[109142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:51 devstack sudo[109142]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1fc106fd-26f5-4f05-93b1-b02fcd42f831 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.0b1b4d5b-06ac-4cd7-b855-a05aba619f43 1G" returned: 0 in 0.796s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:51 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1fc106fd-26f5-4f05-93b1-b02fcd42f831 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.0b1b4d5b-06ac-4cd7-b855-a05aba619f43 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:51 devstack sudo[109147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.0b1b4d5b-06ac-4cd7-b855-a05aba619f43 Jul 03 01:32:51 devstack sudo[109147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:52 devstack sudo[109147]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1fc106fd-26f5-4f05-93b1-b02fcd42f831 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588 -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.0b1b4d5b-06ac-4cd7-b855-a05aba619f43" returned: 0 in 0.677s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:52 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-1fc106fd-26f5-4f05-93b1-b02fcd42f831 tempest-ProjectMemberTests-1744160227 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.0b1b4d5b-06ac-4cd7-b855-a05aba619f43 is being set with open permissions: ugo+rw Jul 03 01:32:52 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1fc106fd-26f5-4f05-93b1-b02fcd42f831 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.0b1b4d5b-06ac-4cd7-b855-a05aba619f43 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:52 devstack sudo[109153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.0b1b4d5b-06ac-4cd7-b855-a05aba619f43 Jul 03 01:32:52 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:53 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1fc106fd-26f5-4f05-93b1-b02fcd42f831 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.0b1b4d5b-06ac-4cd7-b855-a05aba619f43" returned: 0 in 0.643s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1fc106fd-26f5-4f05-93b1-b02fcd42f831 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:53 devstack sudo[109156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.info Jul 03 01:32:53 devstack sudo[109156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:53 devstack sudo[109156]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1fc106fd-26f5-4f05-93b1-b02fcd42f831 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.info" returned: 0 in 0.728s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:53 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-1fc106fd-26f5-4f05-93b1-b02fcd42f831 tempest-ProjectMemberTests-1744160227 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.info is being set with open permissions: ugo+rw Jul 03 01:32:53 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1fc106fd-26f5-4f05-93b1-b02fcd42f831 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:53 devstack sudo[109159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.info Jul 03 01:32:53 devstack sudo[109159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:54 devstack sudo[109159]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-1fc106fd-26f5-4f05-93b1-b02fcd42f831 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.info" returned: 0 in 0.680s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:54 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-1fc106fd-26f5-4f05-93b1-b02fcd42f831 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.422s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:32:54 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-1fc106fd-26f5-4f05-93b1-b02fcd42f831 tempest-ProjectMemberTests-1744160227 None] Create snapshot completed successfully Jul 03 01:32:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c34ddc64-0937-4ed1-9f45-5fd5b4968ffb tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-0b1b4d5b-06ac-4cd7-b855-a05aba619f43-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c34ddc64-0937-4ed1-9f45-5fd5b4968ffb tempest-ProjectMemberTests-1744160227 None] Lock "cinder-0b1b4d5b-06ac-4cd7-b855-a05aba619f43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c34ddc64-0937-4ed1-9f45-5fd5b4968ffb tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-bb4543a5-a94c-4894-a67a-e4ab5b2df588" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c34ddc64-0937-4ed1-9f45-5fd5b4968ffb tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-bb4543a5-a94c-4894-a67a-e4ab5b2df588" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c34ddc64-0937-4ed1-9f45-5fd5b4968ffb tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-0b1b4d5b-06ac-4cd7-b855-a05aba619f43" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:55 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c34ddc64-0937-4ed1-9f45-5fd5b4968ffb tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-0b1b4d5b-06ac-4cd7-b855-a05aba619f43" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-c34ddc64-0937-4ed1-9f45-5fd5b4968ffb tempest-ProjectMemberTests-1744160227 None] Deleting offline snapshot 0b1b4d5b-06ac-4cd7-b855-a05aba619f43 of volume bb4543a5-a94c-4894-a67a-e4ab5b2df588 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:32:55 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-c34ddc64-0937-4ed1-9f45-5fd5b4968ffb tempest-ProjectMemberTests-1744160227 None] snapshot_file for this snap is: volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.0b1b4d5b-06ac-4cd7-b855-a05aba619f43 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:32:55 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b41249-04bc-47a8-9dac-a5ccffd7a37b]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:55 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c34ddc64-0937-4ed1-9f45-5fd5b4968ffb tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.0b1b4d5b-06ac-4cd7-b855-a05aba619f43 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:55 devstack sudo[109162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.0b1b4d5b-06ac-4cd7-b855-a05aba619f43 Jul 03 01:32:55 devstack sudo[109162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:56 devstack sudo[109162]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c34ddc64-0937-4ed1-9f45-5fd5b4968ffb tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.0b1b4d5b-06ac-4cd7-b855-a05aba619f43" returned: 0 in 0.750s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:56 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-c34ddc64-0937-4ed1-9f45-5fd5b4968ffb tempest-ProjectMemberTests-1744160227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:32:56 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[910af095-eb39-4757-82e1-ae3968fdc591]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c34ddc64-0937-4ed1-9f45-5fd5b4968ffb tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:56 devstack sudo[109167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588 Jul 03 01:32:56 devstack sudo[109167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:56 devstack sudo[109167]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c34ddc64-0937-4ed1-9f45-5fd5b4968ffb tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588" returned: 0 in 0.760s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:56 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c34ddc64-0937-4ed1-9f45-5fd5b4968ffb tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.0b1b4d5b-06ac-4cd7-b855-a05aba619f43 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:56 devstack sudo[109172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.0b1b4d5b-06ac-4cd7-b855-a05aba619f43 Jul 03 01:32:56 devstack sudo[109172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:57 devstack sudo[109172]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c34ddc64-0937-4ed1-9f45-5fd5b4968ffb tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.0b1b4d5b-06ac-4cd7-b855-a05aba619f43" returned: 0 in 0.725s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:57 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c34ddc64-0937-4ed1-9f45-5fd5b4968ffb tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.0b1b4d5b-06ac-4cd7-b855-a05aba619f43 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:57 devstack sudo[109177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.0b1b4d5b-06ac-4cd7-b855-a05aba619f43 Jul 03 01:32:57 devstack sudo[109177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:58 devstack sudo[109177]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c34ddc64-0937-4ed1-9f45-5fd5b4968ffb tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588.0b1b4d5b-06ac-4cd7-b855-a05aba619f43" returned: 0 in 0.647s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c34ddc64-0937-4ed1-9f45-5fd5b4968ffb tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-0b1b4d5b-06ac-4cd7-b855-a05aba619f43" released by "_delete_snapshot" :: held 2.967s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c34ddc64-0937-4ed1-9f45-5fd5b4968ffb tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-bb4543a5-a94c-4894-a67a-e4ab5b2df588" released by "delete_snapshot" :: held 2.987s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:58 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-c34ddc64-0937-4ed1-9f45-5fd5b4968ffb tempest-ProjectMemberTests-1744160227 None] Created reservations ['08a94b76-33d2-4b1e-b6e5-665b1677b8ca', '83152201-e685-4984-885e-d43a63c0638c', 'db0bd2b3-d5c4-49a0-8b9b-857a411d0f50', 'c5234937-f856-4331-976f-a84e8dafc8b6'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:32:58 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c34ddc64-0937-4ed1-9f45-5fd5b4968ffb tempest-ProjectMemberTests-1744160227 None] Delete snapshot completed successfully. Jul 03 01:32:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c34ddc64-0937-4ed1-9f45-5fd5b4968ffb tempest-ProjectMemberTests-1744160227 None] Lock "cinder-0b1b4d5b-06ac-4cd7-b855-a05aba619f43-delete_snapshot" released by "delete_snapshot" :: held 3.134s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:32:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-51482de3-3b17-4d01-acae-e011c2436496 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-bb4543a5-a94c-4894-a67a-e4ab5b2df588-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-51482de3-3b17-4d01-acae-e011c2436496 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-bb4543a5-a94c-4894-a67a-e4ab5b2df588-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-51482de3-3b17-4d01-acae-e011c2436496 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-bb4543a5-a94c-4894-a67a-e4ab5b2df588" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:32:58 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-51482de3-3b17-4d01-acae-e011c2436496 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-bb4543a5-a94c-4894-a67a-e4ab5b2df588" acquired by "delete_volume" :: waited 0.013s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:32:58 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8361a8-b78f-45e2-abd4-f15bee5923b8]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:32:58 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-51482de3-3b17-4d01-acae-e011c2436496 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:58 devstack sudo[109180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588 Jul 03 01:32:58 devstack sudo[109180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:32:59 devstack sudo[109180]: pam_unix(sudo:session): session closed for user root Jul 03 01:32:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-51482de3-3b17-4d01-acae-e011c2436496 tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588" returned: 0 in 0.741s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:32:59 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-51482de3-3b17-4d01-acae-e011c2436496 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:32:59 devstack sudo[109185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588 Jul 03 01:32:59 devstack sudo[109185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:00 devstack sudo[109185]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-51482de3-3b17-4d01-acae-e011c2436496 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-bb4543a5-a94c-4894-a67a-e4ab5b2df588" returned: 0 in 0.646s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-51482de3-3b17-4d01-acae-e011c2436496 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-bb4543a5-a94c-4894-a67a-e4ab5b2df588" released by "delete_volume" :: held 1.442s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:00 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-51482de3-3b17-4d01-acae-e011c2436496 tempest-ProjectMemberTests-1744160227 None] Created reservations ['a8ac3610-afe6-41b8-8aca-ac1852a97857', '80f59acc-c53b-45c7-9c29-ef7030ce47c4', '5e2f1bbe-cbe7-4f26-9729-b1003f996459', 'fce8877b-9ab0-4c64-8541-f10630487665'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:33:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-51482de3-3b17-4d01-acae-e011c2436496 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-51482de3-3b17-4d01-acae-e011c2436496 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-51482de3-3b17-4d01-acae-e011c2436496 tempest-ProjectMemberTests-1744160227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:33:00 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-51482de3-3b17-4d01-acae-e011c2436496 tempest-ProjectMemberTests-1744160227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:33:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-51482de3-3b17-4d01-acae-e011c2436496 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-51482de3-3b17-4d01-acae-e011c2436496 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:00 devstack sudo[109188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:33:00 devstack sudo[109188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:00 devstack sudo[109188]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:00 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-51482de3-3b17-4d01-acae-e011c2436496 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.633s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:00 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-51482de3-3b17-4d01-acae-e011c2436496 tempest-ProjectMemberTests-1744160227 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:33:00 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-51482de3-3b17-4d01-acae-e011c2436496 tempest-ProjectMemberTests-1744160227 None] Deleted volume successfully. Jul 03 01:33:00 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-51482de3-3b17-4d01-acae-e011c2436496 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-bb4543a5-a94c-4894-a67a-e4ab5b2df588-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:01 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:33:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Flow 'volume_create_manager' (d8a40a0d-0628-4c02-87ca-6ff6b0c4d581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:33:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1caa9db3-025b-475b-80a4-a4d267f3ca5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1caa9db3-025b-475b-80a4-a4d267f3ca5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-958145082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1266eb6-1c89-4758-8064-c035aaf749dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970504d68ec94910bf67dae1490927d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:33:01Z,use_quota=True,user_id='bc9ce9ff10bf4b2cada6d0ec88b24ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970f96bb-7832-4ec8-9d5f-a378af3cf259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970f96bb-7832-4ec8-9d5f-a378af3cf259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76fb4e11-14b9-457f-83c9-b004cc156bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76fb4e11-14b9-457f-83c9-b004cc156bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1266eb6-1c89-4758-8064-c035aaf749dc', 'volume_name': 'volume-c1266eb6-1c89-4758-8064-c035aaf749dc', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbd0c5d-20fe-419b-80de-eae561f1c943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbd0c5d-20fe-419b-80de-eae561f1c943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:01 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (869ce022-41a1-416b-996b-b7d54418d3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:01 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Volume c1266eb6-1c89-4758-8064-c035aaf749dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1266eb6-1c89-4758-8064-c035aaf749dc', 'volume_size': 1} Jul 03 01:33:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-958145082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1266eb6-1c89-4758-8064-c035aaf749dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970504d68ec94910bf67dae1490927d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:33:01Z,use_quota=True,user_id='bc9ce9ff10bf4b2cada6d0ec88b24ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:33:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Creating volume c1266eb6-1c89-4758-8064-c035aaf749dc {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:33:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:33:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:33:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:01 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:33:01 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:33:01 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:01 devstack sudo[109191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc 1073741824 Jul 03 01:33:01 devstack sudo[109191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:02 devstack sudo[109191]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc 1073741824" returned: 0 in 0.843s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:02 devstack sudo[109196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc Jul 03 01:33:02 devstack sudo[109196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:02 devstack sudo[109196]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc" returned: 0 in 0.653s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:02 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:33:02 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (869ce022-41a1-416b-996b-b7d54418d3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1266eb6-1c89-4758-8064-c035aaf749dc', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf746f04-5f5c-4dae-b8a8-06024f4f5b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:02 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Volume volume-c1266eb6-1c89-4758-8064-c035aaf749dc (c1266eb6-1c89-4758-8064-c035aaf749dc): created successfully Jul 03 01:33:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf746f04-5f5c-4dae-b8a8-06024f4f5b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:02 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Flow 'volume_create_manager' (d8a40a0d-0628-4c02-87ca-6ff6b0c4d581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:33:02 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7f7f1dd8-c45d-4d8e-8a02-d73b06a4c2e2 tempest-ProjectMemberTests-1744160227 None] Created volume successfully. Jul 03 01:33:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-64b74673-1a38-4b06-b874-7ec4a0eca957 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-64b74673-1a38-4b06-b874-7ec4a0eca957 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:03 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-64b74673-1a38-4b06-b874-7ec4a0eca957 tempest-ProjectMemberTests-1744160227 None] Creating offline snapshot f9c4c088-a4da-43b2-96be-9fbaca070f82 of volume c1266eb6-1c89-4758-8064-c035aaf749dc {{(pid=86772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 03 01:33:03 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e65cc09-788c-44ca-8e1f-322542f241ce]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:03 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-64b74673-1a38-4b06-b874-7ec4a0eca957 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:03 devstack sudo[109200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc Jul 03 01:33:03 devstack sudo[109200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:04 devstack sudo[109200]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-64b74673-1a38-4b06-b874-7ec4a0eca957 tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc" returned: 0 in 0.784s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:04 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-64b74673-1a38-4b06-b874-7ec4a0eca957 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc.f9c4c088-a4da-43b2-96be-9fbaca070f82 1G {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:04 devstack sudo[109205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc.f9c4c088-a4da-43b2-96be-9fbaca070f82 1G Jul 03 01:33:04 devstack sudo[109205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:05 devstack sudo[109205]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-64b74673-1a38-4b06-b874-7ec4a0eca957 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc.f9c4c088-a4da-43b2-96be-9fbaca070f82 1G" returned: 0 in 0.778s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-64b74673-1a38-4b06-b874-7ec4a0eca957 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1266eb6-1c89-4758-8064-c035aaf749dc -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc.f9c4c088-a4da-43b2-96be-9fbaca070f82 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:05 devstack sudo[109210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1266eb6-1c89-4758-8064-c035aaf749dc -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc.f9c4c088-a4da-43b2-96be-9fbaca070f82 Jul 03 01:33:05 devstack sudo[109210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:05 devstack sudo[109210]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-64b74673-1a38-4b06-b874-7ec4a0eca957 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1266eb6-1c89-4758-8064-c035aaf749dc -F qcow2 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc.f9c4c088-a4da-43b2-96be-9fbaca070f82" returned: 0 in 0.690s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:05 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-64b74673-1a38-4b06-b874-7ec4a0eca957 tempest-ProjectMemberTests-1744160227 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc.f9c4c088-a4da-43b2-96be-9fbaca070f82 is being set with open permissions: ugo+rw Jul 03 01:33:05 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-64b74673-1a38-4b06-b874-7ec4a0eca957 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc.f9c4c088-a4da-43b2-96be-9fbaca070f82 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:05 devstack sudo[109215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc.f9c4c088-a4da-43b2-96be-9fbaca070f82 Jul 03 01:33:05 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:06 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-64b74673-1a38-4b06-b874-7ec4a0eca957 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc.f9c4c088-a4da-43b2-96be-9fbaca070f82" returned: 0 in 0.666s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:06 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-64b74673-1a38-4b06-b874-7ec4a0eca957 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:06 devstack sudo[109218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc.info Jul 03 01:33:06 devstack sudo[109218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:07 devstack sudo[109218]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-64b74673-1a38-4b06-b874-7ec4a0eca957 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc.info" returned: 0 in 0.642s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:07 devstack cinder-volume[86772]: WARNING cinder.volume.drivers.remotefs [None req-64b74673-1a38-4b06-b874-7ec4a0eca957 tempest-ProjectMemberTests-1744160227 None] /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc.info is being set with open permissions: ugo+rw Jul 03 01:33:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-64b74673-1a38-4b06-b874-7ec4a0eca957 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc.info {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:07 devstack sudo[109221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc.info Jul 03 01:33:07 devstack sudo[109221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:07 devstack sudo[109221]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-64b74673-1a38-4b06-b874-7ec4a0eca957 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc.info" returned: 0 in 0.634s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:07 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-64b74673-1a38-4b06-b874-7ec4a0eca957 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.274s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:07 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-64b74673-1a38-4b06-b874-7ec4a0eca957 tempest-ProjectMemberTests-1744160227 None] Create snapshot completed successfully Jul 03 01:33:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-42e6e8ee-4b4f-4930-9ab7-1a9924b78446 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-f9c4c088-a4da-43b2-96be-9fbaca070f82-delete_snapshot" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-42e6e8ee-4b4f-4930-9ab7-1a9924b78446 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-f9c4c088-a4da-43b2-96be-9fbaca070f82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-42e6e8ee-4b4f-4930-9ab7-1a9924b78446 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-c1266eb6-1c89-4758-8064-c035aaf749dc" by "delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-42e6e8ee-4b4f-4930-9ab7-1a9924b78446 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-c1266eb6-1c89-4758-8064-c035aaf749dc" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-42e6e8ee-4b4f-4930-9ab7-1a9924b78446 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-f9c4c088-a4da-43b2-96be-9fbaca070f82" by "_delete_snapshot" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:08 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-42e6e8ee-4b4f-4930-9ab7-1a9924b78446 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-f9c4c088-a4da-43b2-96be-9fbaca070f82" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-42e6e8ee-4b4f-4930-9ab7-1a9924b78446 tempest-ProjectMemberTests-1744160227 None] Deleting offline snapshot f9c4c088-a4da-43b2-96be-9fbaca070f82 of volume c1266eb6-1c89-4758-8064-c035aaf749dc {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 03 01:33:08 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-42e6e8ee-4b4f-4930-9ab7-1a9924b78446 tempest-ProjectMemberTests-1744160227 None] snapshot_file for this snap is: volume-c1266eb6-1c89-4758-8064-c035aaf749dc.f9c4c088-a4da-43b2-96be-9fbaca070f82 {{(pid=86772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 03 01:33:08 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7206d2-e148-41e1-9765-78a9ee5866be]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:08 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-42e6e8ee-4b4f-4930-9ab7-1a9924b78446 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc.f9c4c088-a4da-43b2-96be-9fbaca070f82 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:08 devstack sudo[109224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc.f9c4c088-a4da-43b2-96be-9fbaca070f82 Jul 03 01:33:08 devstack sudo[109224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:09 devstack sudo[109224]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-42e6e8ee-4b4f-4930-9ab7-1a9924b78446 tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc.f9c4c088-a4da-43b2-96be-9fbaca070f82" returned: 0 in 0.754s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:09 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-42e6e8ee-4b4f-4930-9ab7-1a9924b78446 tempest-ProjectMemberTests-1744160227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1266eb6-1c89-4758-8064-c035aaf749dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 03 01:33:09 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[159731bc-56e6-4246-87e4-eed6ba96065e]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:09 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-42e6e8ee-4b4f-4930-9ab7-1a9924b78446 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:09 devstack sudo[109229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc Jul 03 01:33:09 devstack sudo[109229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:10 devstack sudo[109229]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-42e6e8ee-4b4f-4930-9ab7-1a9924b78446 tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc" returned: 0 in 0.745s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:10 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-42e6e8ee-4b4f-4930-9ab7-1a9924b78446 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc.f9c4c088-a4da-43b2-96be-9fbaca070f82 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:10 devstack sudo[109234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc.f9c4c088-a4da-43b2-96be-9fbaca070f82 Jul 03 01:33:10 devstack sudo[109234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:11 devstack sudo[109234]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-42e6e8ee-4b4f-4930-9ab7-1a9924b78446 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc.f9c4c088-a4da-43b2-96be-9fbaca070f82" returned: 0 in 0.714s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-42e6e8ee-4b4f-4930-9ab7-1a9924b78446 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc.f9c4c088-a4da-43b2-96be-9fbaca070f82 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:11 devstack sudo[109240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc.f9c4c088-a4da-43b2-96be-9fbaca070f82 Jul 03 01:33:11 devstack sudo[109240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:11 devstack sudo[109240]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:11 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-42e6e8ee-4b4f-4930-9ab7-1a9924b78446 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc.f9c4c088-a4da-43b2-96be-9fbaca070f82" returned: 0 in 0.624s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-42e6e8ee-4b4f-4930-9ab7-1a9924b78446 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-f9c4c088-a4da-43b2-96be-9fbaca070f82" released by "_delete_snapshot" :: held 2.920s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-42e6e8ee-4b4f-4930-9ab7-1a9924b78446 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-c1266eb6-1c89-4758-8064-c035aaf749dc" released by "delete_snapshot" :: held 2.942s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:11 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-42e6e8ee-4b4f-4930-9ab7-1a9924b78446 tempest-ProjectMemberTests-1744160227 None] Created reservations ['b9c390ac-033f-4a65-821a-920da213c2bb', 'ce743c5e-fd7e-4d60-866e-e4c1da6f725f', '56629f25-8367-44e1-a344-8b02e65c065d', '6047f522-6c8e-41a2-89fc-255fe97f3e4c'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:33:11 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-42e6e8ee-4b4f-4930-9ab7-1a9924b78446 tempest-ProjectMemberTests-1744160227 None] Delete snapshot completed successfully. Jul 03 01:33:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-42e6e8ee-4b4f-4930-9ab7-1a9924b78446 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-f9c4c088-a4da-43b2-96be-9fbaca070f82-delete_snapshot" released by "delete_snapshot" :: held 3.071s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:11 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c77c798d-488c-4118-8ea5-913759dba0d6 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-c1266eb6-1c89-4758-8064-c035aaf749dc-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c77c798d-488c-4118-8ea5-913759dba0d6 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-c1266eb6-1c89-4758-8064-c035aaf749dc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c77c798d-488c-4118-8ea5-913759dba0d6 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "cinder-quobyte-c1266eb6-1c89-4758-8064-c035aaf749dc" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:12 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c77c798d-488c-4118-8ea5-913759dba0d6 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-c1266eb6-1c89-4758-8064-c035aaf749dc" acquired by "delete_volume" :: waited 0.013s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:12 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[665a366a-0591-4484-bf06-ffdb9cf10b2c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c77c798d-488c-4118-8ea5-913759dba0d6 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:12 devstack sudo[109243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc Jul 03 01:33:12 devstack sudo[109243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:12 devstack sudo[109243]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c77c798d-488c-4118-8ea5-913759dba0d6 tempest-ProjectMemberTests-1744160227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc" returned: 0 in 0.748s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c77c798d-488c-4118-8ea5-913759dba0d6 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:12 devstack sudo[109249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc Jul 03 01:33:12 devstack sudo[109249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:12 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:33:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:33:12 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-748273e3-cf62-4285-9002-93638443de3e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:33:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:12 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:12 devstack sudo[109251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:33:12 devstack sudo[109251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:13 devstack sudo[109249]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c77c798d-488c-4118-8ea5-913759dba0d6 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-c1266eb6-1c89-4758-8064-c035aaf749dc" returned: 0 in 0.663s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:13 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c77c798d-488c-4118-8ea5-913759dba0d6 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-quobyte-c1266eb6-1c89-4758-8064-c035aaf749dc" released by "delete_volume" :: held 1.464s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:13 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-c77c798d-488c-4118-8ea5-913759dba0d6 tempest-ProjectMemberTests-1744160227 None] Created reservations ['4880dd32-b8e5-4ee0-9ebe-5a49b3e49e9b', '16992dd7-3977-43bf-b486-f4c08944eaba', '2f690069-de77-4739-be18-fb50f3983c1e', '412d59d2-6ab2-477e-bdb3-bd9840d13c37'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:33:13 devstack sudo[109251]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-748273e3-cf62-4285-9002-93638443de3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.647s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:13 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:33:13 devstack cinder-volume[86772]: DEBUG oslo_service.periodic_task [None req-748273e3-cf62-4285-9002-93638443de3e None None] Running periodic task VolumeManager._thread_info {{(pid=86772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 03 01:33:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread count: 29 {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 03 01:33:13 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-748273e3-cf62-4285-9002-93638443de3e None None] thread info: [<_MainThread(MainThread, started 133428238037120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 03 01:33:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c77c798d-488c-4118-8ea5-913759dba0d6 tempest-ProjectMemberTests-1744160227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c77c798d-488c-4118-8ea5-913759dba0d6 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c77c798d-488c-4118-8ea5-913759dba0d6 tempest-ProjectMemberTests-1744160227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:33:13 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c77c798d-488c-4118-8ea5-913759dba0d6 tempest-ProjectMemberTests-1744160227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:33:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c77c798d-488c-4118-8ea5-913759dba0d6 tempest-ProjectMemberTests-1744160227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:13 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c77c798d-488c-4118-8ea5-913759dba0d6 tempest-ProjectMemberTests-1744160227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:13 devstack sudo[109257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:33:13 devstack sudo[109257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:14 devstack sudo[109257]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:14 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c77c798d-488c-4118-8ea5-913759dba0d6 tempest-ProjectMemberTests-1744160227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.623s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:14 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-c77c798d-488c-4118-8ea5-913759dba0d6 tempest-ProjectMemberTests-1744160227 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:33:14 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c77c798d-488c-4118-8ea5-913759dba0d6 tempest-ProjectMemberTests-1744160227 None] Deleted volume successfully. Jul 03 01:33:14 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c77c798d-488c-4118-8ea5-913759dba0d6 tempest-ProjectMemberTests-1744160227 None] Lock "cinder-c1266eb6-1c89-4758-8064-c035aaf749dc-delete_volume" released by "delete_volume" :: held 2.274s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:23 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=43,cinder:INSERT=20,cinder:UPDATE=73,cinder:DELETE=4 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:33:24 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=60,cinder:UPDATE=70,cinder:DELETE=8,cinder:INSERT=19 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:33:25 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:33:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Flow 'volume_create_manager' (2b5896bb-b173-47e8-aac2-a52a4d956b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:33:25 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b77c793-f9bb-4825-b514-3e4f117c7343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b77c793-f9bb-4825-b514-3e4f117c7343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1849853141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71acf013-9557-4857-b877-41f3943c00ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5d54a374eac4e82a790ded18d560086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:33:26Z,use_quota=True,user_id='25c9668d3e0440e49b8a1bdf24ae7cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db9b6f12-fad3-419a-9120-5d149742e3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db9b6f12-fad3-419a-9120-5d149742e3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa47587-8bd9-4331-b7e6-f0b2d8117277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa47587-8bd9-4331-b7e6-f0b2d8117277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71acf013-9557-4857-b877-41f3943c00ea', 'volume_name': 'volume-71acf013-9557-4857-b877-41f3943c00ea', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e53bac3c-b467-49f2-a9e0-4c670dd0885c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e53bac3c-b467-49f2-a9e0-4c670dd0885c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:26 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee949226-bcf5-4795-b3cd-7c468615cde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:26 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Volume 71acf013-9557-4857-b877-41f3943c00ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71acf013-9557-4857-b877-41f3943c00ea', 'volume_size': 1} Jul 03 01:33:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1849853141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71acf013-9557-4857-b877-41f3943c00ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5d54a374eac4e82a790ded18d560086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:33:26Z,use_quota=True,user_id='25c9668d3e0440e49b8a1bdf24ae7cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:33:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Creating volume 71acf013-9557-4857-b877-41f3943c00ea {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:33:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:33:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:33:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:26 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:33:26 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:33:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-71acf013-9557-4857-b877-41f3943c00ea 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:26 devstack sudo[109306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-71acf013-9557-4857-b877-41f3943c00ea 1073741824 Jul 03 01:33:26 devstack sudo[109306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:26 devstack sudo[109306]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-71acf013-9557-4857-b877-41f3943c00ea 1073741824" returned: 0 in 0.799s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:26 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-71acf013-9557-4857-b877-41f3943c00ea {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:26 devstack sudo[109312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-71acf013-9557-4857-b877-41f3943c00ea Jul 03 01:33:26 devstack sudo[109312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:27 devstack sudo[109312]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-71acf013-9557-4857-b877-41f3943c00ea" returned: 0 in 0.627s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:27 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:33:27 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee949226-bcf5-4795-b3cd-7c468615cde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71acf013-9557-4857-b877-41f3943c00ea', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d1dbfb-211e-414d-b040-12153b14e7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:27 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Volume volume-71acf013-9557-4857-b877-41f3943c00ea (71acf013-9557-4857-b877-41f3943c00ea): created successfully Jul 03 01:33:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d1dbfb-211e-414d-b040-12153b14e7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:27 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Flow 'volume_create_manager' (2b5896bb-b173-47e8-aac2-a52a4d956b9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:33:27 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-7d7e3fb4-d76a-4f44-9993-2692747209d1 tempest-ProjectReaderTests-2044338461 None] Created volume successfully. Jul 03 01:33:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ea95a69d-3887-4246-9e55-bb063102aade tempest-ProjectReaderTests-2044338461 None] Acquiring lock "cinder-71acf013-9557-4857-b877-41f3943c00ea-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ea95a69d-3887-4246-9e55-bb063102aade tempest-ProjectReaderTests-2044338461 None] Lock "cinder-71acf013-9557-4857-b877-41f3943c00ea-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ea95a69d-3887-4246-9e55-bb063102aade tempest-ProjectReaderTests-2044338461 None] Acquiring lock "cinder-quobyte-71acf013-9557-4857-b877-41f3943c00ea" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:28 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ea95a69d-3887-4246-9e55-bb063102aade tempest-ProjectReaderTests-2044338461 None] Lock "cinder-quobyte-71acf013-9557-4857-b877-41f3943c00ea" acquired by "delete_volume" :: waited 0.014s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:28 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bdffe0-3d0a-48ee-8466-327ec3cadb6c]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea95a69d-3887-4246-9e55-bb063102aade tempest-ProjectReaderTests-2044338461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-71acf013-9557-4857-b877-41f3943c00ea {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:28 devstack sudo[109315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-71acf013-9557-4857-b877-41f3943c00ea Jul 03 01:33:28 devstack sudo[109315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:28 devstack sudo[109315]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea95a69d-3887-4246-9e55-bb063102aade tempest-ProjectReaderTests-2044338461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-71acf013-9557-4857-b877-41f3943c00ea" returned: 0 in 0.740s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:28 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea95a69d-3887-4246-9e55-bb063102aade tempest-ProjectReaderTests-2044338461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-71acf013-9557-4857-b877-41f3943c00ea {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:29 devstack sudo[109320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-71acf013-9557-4857-b877-41f3943c00ea Jul 03 01:33:29 devstack sudo[109320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:29 devstack sudo[109320]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea95a69d-3887-4246-9e55-bb063102aade tempest-ProjectReaderTests-2044338461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-71acf013-9557-4857-b877-41f3943c00ea" returned: 0 in 0.632s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:29 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ea95a69d-3887-4246-9e55-bb063102aade tempest-ProjectReaderTests-2044338461 None] Lock "cinder-quobyte-71acf013-9557-4857-b877-41f3943c00ea" released by "delete_volume" :: held 1.414s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:29 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-ea95a69d-3887-4246-9e55-bb063102aade tempest-ProjectReaderTests-2044338461 None] Created reservations ['f0bb4226-ed19-4c71-824b-92abeb76c563', 'e166ecf3-bd58-4fb5-bdf4-8ae28d08c993', '5c9ea363-c952-429b-89bf-13a63edb14c9', 'afbfc442-3162-4e18-b996-1ae0ca2d78f0'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:33:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ea95a69d-3887-4246-9e55-bb063102aade tempest-ProjectReaderTests-2044338461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ea95a69d-3887-4246-9e55-bb063102aade tempest-ProjectReaderTests-2044338461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ea95a69d-3887-4246-9e55-bb063102aade tempest-ProjectReaderTests-2044338461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:33:29 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-ea95a69d-3887-4246-9e55-bb063102aade tempest-ProjectReaderTests-2044338461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:33:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-ea95a69d-3887-4246-9e55-bb063102aade tempest-ProjectReaderTests-2044338461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:29 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea95a69d-3887-4246-9e55-bb063102aade tempest-ProjectReaderTests-2044338461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:29 devstack sudo[109323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:33:29 devstack sudo[109323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:30 devstack sudo[109323]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-ea95a69d-3887-4246-9e55-bb063102aade tempest-ProjectReaderTests-2044338461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.681s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:30 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-ea95a69d-3887-4246-9e55-bb063102aade tempest-ProjectReaderTests-2044338461 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:33:30 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-ea95a69d-3887-4246-9e55-bb063102aade tempest-ProjectReaderTests-2044338461 None] Deleted volume successfully. Jul 03 01:33:30 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-ea95a69d-3887-4246-9e55-bb063102aade tempest-ProjectReaderTests-2044338461 None] Lock "cinder-71acf013-9557-4857-b877-41f3943c00ea-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:30 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:33:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Flow 'volume_create_manager' (4e298e2b-c810-47a0-aa11-90bfafc91a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:33:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af1a1d5-b555-40cb-aec6-8cf48bb79910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af1a1d5-b555-40cb-aec6-8cf48bb79910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1918071837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69662079-3f41-46a3-a5ad-b46214fcb2fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5d54a374eac4e82a790ded18d560086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:33:31Z,use_quota=True,user_id='25c9668d3e0440e49b8a1bdf24ae7cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49f4639-11df-4fb2-a314-11028becf1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49f4639-11df-4fb2-a314-11028becf1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac28b5d0-8dea-4f4e-91fc-6e74c3f61cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac28b5d0-8dea-4f4e-91fc-6e74c3f61cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69662079-3f41-46a3-a5ad-b46214fcb2fb', 'volume_name': 'volume-69662079-3f41-46a3-a5ad-b46214fcb2fb', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73af23d-1c23-4a4b-bf57-b08845698895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73af23d-1c23-4a4b-bf57-b08845698895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:30 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86984e5-5800-4c76-b584-d5e7e5e048b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:30 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Volume 69662079-3f41-46a3-a5ad-b46214fcb2fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69662079-3f41-46a3-a5ad-b46214fcb2fb', 'volume_size': 1} Jul 03 01:33:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1918071837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69662079-3f41-46a3-a5ad-b46214fcb2fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5d54a374eac4e82a790ded18d560086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:33:31Z,use_quota=True,user_id='25c9668d3e0440e49b8a1bdf24ae7cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:33:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Creating volume 69662079-3f41-46a3-a5ad-b46214fcb2fb {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:33:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:33:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:33:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:30 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:33:30 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:33:30 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-69662079-3f41-46a3-a5ad-b46214fcb2fb 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:30 devstack sudo[109326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-69662079-3f41-46a3-a5ad-b46214fcb2fb 1073741824 Jul 03 01:33:30 devstack sudo[109326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:31 devstack sudo[109326]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-69662079-3f41-46a3-a5ad-b46214fcb2fb 1073741824" returned: 0 in 0.792s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:31 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-69662079-3f41-46a3-a5ad-b46214fcb2fb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:31 devstack sudo[109331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-69662079-3f41-46a3-a5ad-b46214fcb2fb Jul 03 01:33:31 devstack sudo[109331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:32 devstack sudo[109331]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-69662079-3f41-46a3-a5ad-b46214fcb2fb" returned: 0 in 0.643s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:32 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:33:32 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86984e5-5800-4c76-b584-d5e7e5e048b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69662079-3f41-46a3-a5ad-b46214fcb2fb', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (796737e7-5a28-4ecb-ba32-1888e9079725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:32 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Volume volume-69662079-3f41-46a3-a5ad-b46214fcb2fb (69662079-3f41-46a3-a5ad-b46214fcb2fb): created successfully Jul 03 01:33:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (796737e7-5a28-4ecb-ba32-1888e9079725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:32 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Flow 'volume_create_manager' (4e298e2b-c810-47a0-aa11-90bfafc91a03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:33:32 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a3f9efe5-a711-4720-9bf8-b137e6fb9c3f tempest-ProjectReaderTests-2044338461 None] Created volume successfully. Jul 03 01:33:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c63ab0a1-9d27-452e-b298-e70533aeb674 tempest-ProjectReaderTests-2044338461 None] Acquiring lock "cinder-69662079-3f41-46a3-a5ad-b46214fcb2fb-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c63ab0a1-9d27-452e-b298-e70533aeb674 tempest-ProjectReaderTests-2044338461 None] Lock "cinder-69662079-3f41-46a3-a5ad-b46214fcb2fb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:32 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c63ab0a1-9d27-452e-b298-e70533aeb674 tempest-ProjectReaderTests-2044338461 None] Acquiring lock "cinder-quobyte-69662079-3f41-46a3-a5ad-b46214fcb2fb" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:33 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c63ab0a1-9d27-452e-b298-e70533aeb674 tempest-ProjectReaderTests-2044338461 None] Lock "cinder-quobyte-69662079-3f41-46a3-a5ad-b46214fcb2fb" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:33 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fc4d12-88c8-4357-9254-e7b11e8155c1]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c63ab0a1-9d27-452e-b298-e70533aeb674 tempest-ProjectReaderTests-2044338461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-69662079-3f41-46a3-a5ad-b46214fcb2fb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:33 devstack sudo[109335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-69662079-3f41-46a3-a5ad-b46214fcb2fb Jul 03 01:33:33 devstack sudo[109335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:33 devstack sudo[109335]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c63ab0a1-9d27-452e-b298-e70533aeb674 tempest-ProjectReaderTests-2044338461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-69662079-3f41-46a3-a5ad-b46214fcb2fb" returned: 0 in 0.756s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:33 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c63ab0a1-9d27-452e-b298-e70533aeb674 tempest-ProjectReaderTests-2044338461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-69662079-3f41-46a3-a5ad-b46214fcb2fb {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:33 devstack sudo[109340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-69662079-3f41-46a3-a5ad-b46214fcb2fb Jul 03 01:33:33 devstack sudo[109340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:34 devstack sudo[109340]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c63ab0a1-9d27-452e-b298-e70533aeb674 tempest-ProjectReaderTests-2044338461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-69662079-3f41-46a3-a5ad-b46214fcb2fb" returned: 0 in 0.636s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:34 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c63ab0a1-9d27-452e-b298-e70533aeb674 tempest-ProjectReaderTests-2044338461 None] Lock "cinder-quobyte-69662079-3f41-46a3-a5ad-b46214fcb2fb" released by "delete_volume" :: held 1.428s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:34 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-c63ab0a1-9d27-452e-b298-e70533aeb674 tempest-ProjectReaderTests-2044338461 None] Created reservations ['f14bbe1b-b1a2-46ff-9809-cccc2e615d07', '1552e65a-f65a-4428-bdd1-378ad67540f3', '358a7a7e-f58f-4911-bcfb-b4114b085408', 'f2452cec-026e-4dc6-8f24-6f812657312e'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:33:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c63ab0a1-9d27-452e-b298-e70533aeb674 tempest-ProjectReaderTests-2044338461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c63ab0a1-9d27-452e-b298-e70533aeb674 tempest-ProjectReaderTests-2044338461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c63ab0a1-9d27-452e-b298-e70533aeb674 tempest-ProjectReaderTests-2044338461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:33:34 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-c63ab0a1-9d27-452e-b298-e70533aeb674 tempest-ProjectReaderTests-2044338461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:33:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-c63ab0a1-9d27-452e-b298-e70533aeb674 tempest-ProjectReaderTests-2044338461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:34 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c63ab0a1-9d27-452e-b298-e70533aeb674 tempest-ProjectReaderTests-2044338461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:34 devstack sudo[109343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:33:34 devstack sudo[109343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:35 devstack sudo[109343]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-c63ab0a1-9d27-452e-b298-e70533aeb674 tempest-ProjectReaderTests-2044338461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.680s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:35 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-c63ab0a1-9d27-452e-b298-e70533aeb674 tempest-ProjectReaderTests-2044338461 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:33:35 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-c63ab0a1-9d27-452e-b298-e70533aeb674 tempest-ProjectReaderTests-2044338461 None] Deleted volume successfully. Jul 03 01:33:35 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-c63ab0a1-9d27-452e-b298-e70533aeb674 tempest-ProjectReaderTests-2044338461 None] Lock "cinder-69662079-3f41-46a3-a5ad-b46214fcb2fb-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:35 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:33:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Flow 'volume_create_manager' (35019934-7e19-439c-8e0d-ca8a4762c856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:33:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4eca72-215a-40b8-8193-8d7a18e6068f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4eca72-215a-40b8-8193-8d7a18e6068f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1014963823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e46854b-3e4f-48c1-97bd-f0b30970c737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5d54a374eac4e82a790ded18d560086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:33:36Z,use_quota=True,user_id='25c9668d3e0440e49b8a1bdf24ae7cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2376ec-f9c0-4e6b-8698-9dd29d1f7891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2376ec-f9c0-4e6b-8698-9dd29d1f7891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156ee512-cd6f-4727-96ec-15d05b81cdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156ee512-cd6f-4727-96ec-15d05b81cdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e46854b-3e4f-48c1-97bd-f0b30970c737', 'volume_name': 'volume-1e46854b-3e4f-48c1-97bd-f0b30970c737', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd90042-6b73-4e1c-a8cb-2c8714e9555a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd90042-6b73-4e1c-a8cb-2c8714e9555a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:35 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43f80f4-b0b7-47cc-bce6-a09751b7e533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:35 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Volume 1e46854b-3e4f-48c1-97bd-f0b30970c737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e46854b-3e4f-48c1-97bd-f0b30970c737', 'volume_size': 1} Jul 03 01:33:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1014963823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e46854b-3e4f-48c1-97bd-f0b30970c737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5d54a374eac4e82a790ded18d560086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:33:36Z,use_quota=True,user_id='25c9668d3e0440e49b8a1bdf24ae7cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:33:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Creating volume 1e46854b-3e4f-48c1-97bd-f0b30970c737 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:33:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:33:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:33:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:35 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:33:35 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:33:35 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1e46854b-3e4f-48c1-97bd-f0b30970c737 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:35 devstack sudo[109346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1e46854b-3e4f-48c1-97bd-f0b30970c737 1073741824 Jul 03 01:33:35 devstack sudo[109346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:36 devstack sudo[109346]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1e46854b-3e4f-48c1-97bd-f0b30970c737 1073741824" returned: 0 in 0.816s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:36 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1e46854b-3e4f-48c1-97bd-f0b30970c737 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:36 devstack sudo[109351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1e46854b-3e4f-48c1-97bd-f0b30970c737 Jul 03 01:33:36 devstack sudo[109351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:37 devstack sudo[109351]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1e46854b-3e4f-48c1-97bd-f0b30970c737" returned: 0 in 0.644s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:37 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:33:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43f80f4-b0b7-47cc-bce6-a09751b7e533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e46854b-3e4f-48c1-97bd-f0b30970c737', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835a8188-374c-40d5-9f51-53d5c2ea9cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:37 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Volume volume-1e46854b-3e4f-48c1-97bd-f0b30970c737 (1e46854b-3e4f-48c1-97bd-f0b30970c737): created successfully Jul 03 01:33:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835a8188-374c-40d5-9f51-53d5c2ea9cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:37 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Flow 'volume_create_manager' (35019934-7e19-439c-8e0d-ca8a4762c856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:33:37 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-f1d95daf-2d34-4ad3-a0b0-c1620fb92f88 tempest-ProjectReaderTests-2044338461 None] Created volume successfully. Jul 03 01:33:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3f88d930-899c-4488-91db-18c6669732dd tempest-ProjectReaderTests-2044338461 None] Acquiring lock "cinder-1e46854b-3e4f-48c1-97bd-f0b30970c737-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3f88d930-899c-4488-91db-18c6669732dd tempest-ProjectReaderTests-2044338461 None] Lock "cinder-1e46854b-3e4f-48c1-97bd-f0b30970c737-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3f88d930-899c-4488-91db-18c6669732dd tempest-ProjectReaderTests-2044338461 None] Acquiring lock "cinder-quobyte-1e46854b-3e4f-48c1-97bd-f0b30970c737" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:37 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3f88d930-899c-4488-91db-18c6669732dd tempest-ProjectReaderTests-2044338461 None] Lock "cinder-quobyte-1e46854b-3e4f-48c1-97bd-f0b30970c737" acquired by "delete_volume" :: waited 0.018s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:37 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[03701ea1-502b-4400-a96d-5f101dff9c16]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:37 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3f88d930-899c-4488-91db-18c6669732dd tempest-ProjectReaderTests-2044338461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1e46854b-3e4f-48c1-97bd-f0b30970c737 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:37 devstack sudo[109354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1e46854b-3e4f-48c1-97bd-f0b30970c737 Jul 03 01:33:37 devstack sudo[109354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:38 devstack sudo[109354]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3f88d930-899c-4488-91db-18c6669732dd tempest-ProjectReaderTests-2044338461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1e46854b-3e4f-48c1-97bd-f0b30970c737" returned: 0 in 0.754s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:38 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3f88d930-899c-4488-91db-18c6669732dd tempest-ProjectReaderTests-2044338461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1e46854b-3e4f-48c1-97bd-f0b30970c737 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:38 devstack sudo[109359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1e46854b-3e4f-48c1-97bd-f0b30970c737 Jul 03 01:33:38 devstack sudo[109359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:39 devstack sudo[109359]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3f88d930-899c-4488-91db-18c6669732dd tempest-ProjectReaderTests-2044338461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-1e46854b-3e4f-48c1-97bd-f0b30970c737" returned: 0 in 0.678s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:39 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3f88d930-899c-4488-91db-18c6669732dd tempest-ProjectReaderTests-2044338461 None] Lock "cinder-quobyte-1e46854b-3e4f-48c1-97bd-f0b30970c737" released by "delete_volume" :: held 1.470s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:39 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-3f88d930-899c-4488-91db-18c6669732dd tempest-ProjectReaderTests-2044338461 None] Created reservations ['b3a837cf-660a-436b-8b34-2a66a5e96800', '3334410a-cf3f-466f-856f-60d70b7b3f89', '0bc71f4f-ae1e-4b7a-a2dc-ab4da33095f6', 'e08b8c96-8dfe-48a0-9e1a-55f1f153c760'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:33:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3f88d930-899c-4488-91db-18c6669732dd tempest-ProjectReaderTests-2044338461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3f88d930-899c-4488-91db-18c6669732dd tempest-ProjectReaderTests-2044338461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3f88d930-899c-4488-91db-18c6669732dd tempest-ProjectReaderTests-2044338461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:33:39 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3f88d930-899c-4488-91db-18c6669732dd tempest-ProjectReaderTests-2044338461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:33:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3f88d930-899c-4488-91db-18c6669732dd tempest-ProjectReaderTests-2044338461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:39 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3f88d930-899c-4488-91db-18c6669732dd tempest-ProjectReaderTests-2044338461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:39 devstack sudo[109362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:33:39 devstack sudo[109362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:40 devstack sudo[109362]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3f88d930-899c-4488-91db-18c6669732dd tempest-ProjectReaderTests-2044338461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.670s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:40 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-3f88d930-899c-4488-91db-18c6669732dd tempest-ProjectReaderTests-2044338461 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:33:40 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3f88d930-899c-4488-91db-18c6669732dd tempest-ProjectReaderTests-2044338461 None] Deleted volume successfully. Jul 03 01:33:40 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-3f88d930-899c-4488-91db-18c6669732dd tempest-ProjectReaderTests-2044338461 None] Lock "cinder-1e46854b-3e4f-48c1-97bd-f0b30970c737-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:40 devstack cinder-volume[86772]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 03 01:33:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Flow 'volume_create_manager' (41ab665a-3e65-4312-a378-d307d73ea469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:33:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1b83e1-d3e4-42c0-8696-00ff7cc4ffc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1b83e1-d3e4-42c0-8696-00ff7cc4ffc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-604653704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f77057f-8525-40e4-925f-07e96be97579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5d54a374eac4e82a790ded18d560086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:33:40Z,use_quota=True,user_id='25c9668d3e0440e49b8a1bdf24ae7cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109f9ba3-334b-43ec-b940-2fd4c0868465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109f9ba3-334b-43ec-b940-2fd4c0868465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7019e581-dabf-49fc-b263-75049fd16c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7019e581-dabf-49fc-b263-75049fd16c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f77057f-8525-40e4-925f-07e96be97579', 'volume_name': 'volume-7f77057f-8525-40e4-925f-07e96be97579', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f776e2da-364f-47e5-b5b2-9f137b9144df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f776e2da-364f-47e5-b5b2-9f137b9144df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:40 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95348378-a926-4400-b097-ac8d93a1f090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:40 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Volume 7f77057f-8525-40e4-925f-07e96be97579: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f77057f-8525-40e4-925f-07e96be97579', 'volume_size': 1} Jul 03 01:33:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-02T23:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-604653704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f77057f-8525-40e4-925f-07e96be97579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5d54a374eac4e82a790ded18d560086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-02T23:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-02T23:33:40Z,use_quota=True,user_id='25c9668d3e0440e49b8a1bdf24ae7cc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(124f89cb-ad29-4528-b47d-e611619779eb),volume_type_id=124f89cb-ad29-4528-b47d-e611619779eb)}" {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 03 01:33:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.remotefs [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Creating volume 7f77057f-8525-40e4-925f-07e96be97579 {{(pid=86772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 03 01:33:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:33:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:33:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:40 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Selected osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 as target Quobyte volume. {{(pid=86772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 03 01:33:40 devstack cinder-volume[86772]: INFO cinder.volume.drivers.remotefs [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] casted to osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171 Jul 03 01:33:40 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7f77057f-8525-40e4-925f-07e96be97579 1073741824 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:40 devstack sudo[109365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7f77057f-8525-40e4-925f-07e96be97579 1073741824 Jul 03 01:33:40 devstack sudo[109365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:41 devstack sudo[109365]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7f77057f-8525-40e4-925f-07e96be97579 1073741824" returned: 0 in 0.779s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7f77057f-8525-40e4-925f-07e96be97579 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:41 devstack sudo[109371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7f77057f-8525-40e4-925f-07e96be97579 Jul 03 01:33:41 devstack sudo[109371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:41 devstack sudo[109371]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7f77057f-8525-40e4-925f-07e96be97579" returned: 0 in 0.618s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:41 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'} {{(pid=86772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 03 01:33:41 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95348378-a926-4400-b097-ac8d93a1f090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f77057f-8525-40e4-925f-07e96be97579', 'volume_size': 1}' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b78fa47-b55d-470d-b914-c362beb23abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 03 01:33:42 devstack cinder-volume[86772]: INFO cinder.volume.flows.manager.create_volume [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Volume volume-7f77057f-8525-40e4-925f-07e96be97579 (7f77057f-8525-40e4-925f-07e96be97579): created successfully Jul 03 01:33:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b78fa47-b55d-470d-b914-c362beb23abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 03 01:33:42 devstack cinder-volume[86772]: DEBUG cinder.volume.manager [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Flow 'volume_create_manager' (41ab665a-3e65-4312-a378-d307d73ea469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 03 01:33:42 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-3d7a4ff7-40dd-4e21-a082-4950fc9a3cbe tempest-ProjectReaderTests-2044338461 None] Created volume successfully. Jul 03 01:33:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a32414e4-3fc9-4485-b55f-6e62bcf5c4e4 tempest-ProjectReaderTests-2044338461 None] Acquiring lock "cinder-7f77057f-8525-40e4-925f-07e96be97579-delete_volume" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a32414e4-3fc9-4485-b55f-6e62bcf5c4e4 tempest-ProjectReaderTests-2044338461 None] Lock "cinder-7f77057f-8525-40e4-925f-07e96be97579-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a32414e4-3fc9-4485-b55f-6e62bcf5c4e4 tempest-ProjectReaderTests-2044338461 None] Acquiring lock "cinder-quobyte-7f77057f-8525-40e4-925f-07e96be97579" by "delete_volume" {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 03 01:33:42 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a32414e4-3fc9-4485-b55f-6e62bcf5c4e4 tempest-ProjectReaderTests-2044338461 None] Lock "cinder-quobyte-7f77057f-8525-40e4-925f-07e96be97579" acquired by "delete_volume" :: waited 0.013s {{(pid=86772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 03 01:33:42 devstack cinder-volume[86772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbb2cf0-8227-4db7-ad8c-29bd763cf2e5]: (4, 'qcow2') {{(pid=88216) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 03 01:33:42 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a32414e4-3fc9-4485-b55f-6e62bcf5c4e4 tempest-ProjectReaderTests-2044338461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7f77057f-8525-40e4-925f-07e96be97579 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:42 devstack sudo[109375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7f77057f-8525-40e4-925f-07e96be97579 Jul 03 01:33:42 devstack sudo[109375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:43 devstack sudo[109375]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a32414e4-3fc9-4485-b55f-6e62bcf5c4e4 tempest-ProjectReaderTests-2044338461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7f77057f-8525-40e4-925f-07e96be97579" returned: 0 in 0.718s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:43 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a32414e4-3fc9-4485-b55f-6e62bcf5c4e4 tempest-ProjectReaderTests-2044338461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7f77057f-8525-40e4-925f-07e96be97579 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:43 devstack sudo[109380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7f77057f-8525-40e4-925f-07e96be97579 Jul 03 01:33:43 devstack sudo[109380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:44 devstack sudo[109380]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a32414e4-3fc9-4485-b55f-6e62bcf5c4e4 tempest-ProjectReaderTests-2044338461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23/volume-7f77057f-8525-40e4-925f-07e96be97579" returned: 0 in 0.640s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a32414e4-3fc9-4485-b55f-6e62bcf5c4e4 tempest-ProjectReaderTests-2044338461 None] Lock "cinder-quobyte-7f77057f-8525-40e4-925f-07e96be97579" released by "delete_volume" :: held 1.396s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:44 devstack cinder-volume[86772]: DEBUG cinder.quota [None req-a32414e4-3fc9-4485-b55f-6e62bcf5c4e4 tempest-ProjectReaderTests-2044338461 None] Created reservations ['b594c8ae-2150-4895-abca-c29528616389', '5dd569c4-30e3-49fd-8b6c-083b7bb5a1e0', 'e548e5b6-6d70-45db-b971-9f170da307a6', '919bcc1a-f155-4601-a838-49e047962a9f'] {{(pid=86772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 03 01:33:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a32414e4-3fc9-4485-b55f-6e62bcf5c4e4 tempest-ProjectReaderTests-2044338461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 03 01:33:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a32414e4-3fc9-4485-b55f-6e62bcf5c4e4 tempest-ProjectReaderTests-2044338461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 03 01:33:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a32414e4-3fc9-4485-b55f-6e62bcf5c4e4 tempest-ProjectReaderTests-2044338461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171': None} {{(pid=86772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 03 01:33:44 devstack cinder-volume[86772]: DEBUG cinder.volume.drivers.quobyte [None req-a32414e4-3fc9-4485-b55f-6e62bcf5c4e4 tempest-ProjectReaderTests-2044338461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-466306e4-bd41-448c-9adc-c83c7d81d171'] {{(pid=86772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 03 01:33:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.lockutils [None req-a32414e4-3fc9-4485-b55f-6e62bcf5c4e4 tempest-ProjectReaderTests-2044338461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 03 01:33:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a32414e4-3fc9-4485-b55f-6e62bcf5c4e4 tempest-ProjectReaderTests-2044338461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 03 01:33:44 devstack sudo[109383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23 Jul 03 01:33:44 devstack sudo[109383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 03 01:33:44 devstack sudo[109383]: pam_unix(sudo:session): session closed for user root Jul 03 01:33:44 devstack cinder-volume[86772]: DEBUG oslo_concurrency.processutils [None req-a32414e4-3fc9-4485-b55f-6e62bcf5c4e4 tempest-ProjectReaderTests-2044338461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b453e831081e89184b1c9bb6cb63fc23" returned: 0 in 0.651s {{(pid=86772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 03 01:33:44 devstack cinder-volume[86772]: DEBUG cinder.manager [None req-a32414e4-3fc9-4485-b55f-6e62bcf5c4e4 tempest-ProjectReaderTests-2044338461 None] Notifying Schedulers of capabilities ... {{(pid=86772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 03 01:33:44 devstack cinder-volume[86772]: INFO cinder.volume.manager [None req-a32414e4-3fc9-4485-b55f-6e62bcf5c4e4 tempest-ProjectReaderTests-2044338461 None] Deleted volume successfully. Jul 03 01:33:44 devstack cinder-volume[86772]: DEBUG cinder.coordination [None req-a32414e4-3fc9-4485-b55f-6e62bcf5c4e4 tempest-ProjectReaderTests-2044338461 None] Lock "cinder-7f77057f-8525-40e4-925f-07e96be97579-delete_volume" released by "delete_volume" :: held 2.221s {{(pid=86772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 03 01:33:54 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=30,cinder:UPDATE=48,cinder:INSERT=10,cinder:DELETE=4 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:33:54 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=40,cinder:SELECT=26,cinder:INSERT=10,cinder:DELETE=4 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:34:07 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:SELECT=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 03 01:34:07 devstack cinder-volume[86772]: DEBUG dbcounter [-] [86772] Writing DB stats cinder:UPDATE=1 {{(pid=86772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}